Jul 20 16:01:30.677237 ip-10-0-129-222 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 16:01:30.677247 ip-10-0-129-222 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 16:01:30.677256 ip-10-0-129-222 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 16:01:30.677551 ip-10-0-129-222 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 16:01:40.797412 ip-10-0-129-222 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 16:01:40.797427 ip-10-0-129-222 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f5d0ef33bcfe4691b417664b7a12bfcf -- Jul 20 16:03:40.492587 ip-10-0-129-222 systemd[1]: Starting Kubernetes Kubelet... Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.894462 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899614 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899627 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899631 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899634 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899637 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899643 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899646 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:03:40.938216 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899649 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899653 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899656 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899658 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899661 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899664 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899666 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899669 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899672 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899675 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899679 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899683 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899686 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899689 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899692 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899695 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899698 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899701 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899704 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:03:40.940700 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899708 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899710 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899713 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899715 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899718 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899720 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899723 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899727 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899730 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899732 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899735 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899737 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899740 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899743 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899746 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899748 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899751 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899753 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899756 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899758 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:03:40.943121 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899760 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899763 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899766 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899768 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899771 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899774 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899777 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899779 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899783 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899785 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899789 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899791 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899794 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899796 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899799 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899802 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899805 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899807 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899810 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899813 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:03:40.944761 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899816 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899819 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899821 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899824 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899826 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899829 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899832 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899834 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899836 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899840 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899842 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899845 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899848 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899850 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899853 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899856 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899858 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899861 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899864 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:03:40.945632 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899867 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899871 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899874 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899877 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899880 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899883 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899886 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899889 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899891 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899894 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899897 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899900 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899903 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.899905 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900586 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900594 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900597 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900600 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900603 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900606 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:03:40.946708 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900609 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900611 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900614 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900617 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900620 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900623 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900626 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900629 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900632 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900635 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900637 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900640 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900643 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900648 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900651 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900655 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900658 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900661 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900664 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:03:40.947311 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900667 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900670 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900673 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900676 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900678 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900681 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900684 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900687 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900690 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900693 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900696 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900698 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900701 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900703 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900707 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900711 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900713 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900716 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900719 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900722 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:03:40.947912 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900724 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900727 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900730 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900732 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900735 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900737 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900740 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900743 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900745 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900748 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900750 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900753 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900756 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900758 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900761 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900765 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900768 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900770 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900773 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900776 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:03:40.948526 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900779 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900782 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900784 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900787 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900790 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900793 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900795 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900798 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900800 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900802 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900805 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900807 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900810 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900813 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900815 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900818 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900821 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900823 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900826 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900828 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:03:40.949130 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900831 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900833 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900836 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900838 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900840 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900843 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900846 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900850 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900853 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900856 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900858 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900861 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900865 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.900868 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901225 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901231 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901234 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901236 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901239 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901241 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:03:40.949773 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901245 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901247 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901250 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901253 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901256 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901259 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901261 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901264 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901267 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901270 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901272 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901275 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901277 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901280 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901282 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901285 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901287 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901290 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901293 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901297 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:03:40.950295 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901299 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901302 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901307 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901310 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901314 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901317 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901320 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901323 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901326 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901328 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901331 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901333 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901336 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901338 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901341 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901362 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901365 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901368 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901372 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901375 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:03:40.950899 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901377 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901380 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901383 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901386 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901388 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901391 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901394 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901396 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901399 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901401 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901404 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901408 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901411 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901413 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901416 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901418 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901421 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901423 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901426 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901429 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:03:40.951460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901431 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901434 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901436 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901439 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901441 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901446 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901449 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901452 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901455 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901457 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901462 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901464 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901466 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901469 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901471 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901474 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901476 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901479 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901481 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:03:40.952008 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901484 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901486 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901490 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901494 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901498 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901500 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901503 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901505 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901508 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901511 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901513 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901516 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901518 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.901521 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901587 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901594 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901600 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901604 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901608 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901611 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901615 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 16:03:40.952534 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901619 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901622 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901626 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901630 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901634 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901637 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901640 2561 flags.go:64] FLAG: --cgroup-root="" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901642 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901645 2561 flags.go:64] FLAG: --client-ca-file="" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901648 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901651 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901656 2561 flags.go:64] FLAG: --cluster-domain="" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901659 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901662 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901665 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901669 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901673 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901676 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901679 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901682 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901685 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901688 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901691 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901695 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 16:03:40.953213 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901697 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901702 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901705 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901709 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901711 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901714 2561 flags.go:64] FLAG: --enable-server="true" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901717 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901721 2561 flags.go:64] FLAG: --event-burst="100" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901724 2561 flags.go:64] FLAG: --event-qps="50" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901727 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901731 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901734 2561 flags.go:64] FLAG: --eviction-hard="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901738 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901741 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901744 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901747 2561 flags.go:64] FLAG: --eviction-soft="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901750 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901753 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901756 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901759 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901762 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901765 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901768 2561 flags.go:64] FLAG: --feature-gates="" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901773 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901776 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 16:03:40.953838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901779 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901782 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901785 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901788 2561 flags.go:64] FLAG: --help="false" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901791 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-222.ec2.internal" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901794 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901797 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901800 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901804 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901808 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901811 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901813 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901816 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901819 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901822 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901825 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901828 2561 flags.go:64] FLAG: --kube-reserved="" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901832 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901835 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901838 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901841 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901844 2561 flags.go:64] FLAG: --lock-file="" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901847 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901849 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 16:03:40.954578 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901853 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901858 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901861 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901864 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901867 2561 flags.go:64] FLAG: --logging-format="text" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901869 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901875 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901878 2561 flags.go:64] FLAG: --manifest-url="" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901881 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901885 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901888 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901892 2561 flags.go:64] FLAG: --max-pods="110" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901894 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901897 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901900 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901903 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901906 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901909 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901913 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901920 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901923 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901926 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901929 2561 flags.go:64] FLAG: --pod-cidr="" Jul 20 16:03:40.955626 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901932 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901937 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901941 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901945 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901948 2561 flags.go:64] FLAG: --port="10250" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901951 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901954 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c3f283937b4c54a" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901957 2561 flags.go:64] FLAG: --qos-reserved="" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901960 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901963 2561 flags.go:64] FLAG: --register-node="true" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901966 2561 flags.go:64] FLAG: --register-with-taints="" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901969 2561 flags.go:64] FLAG: --registry-burst="10" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901972 2561 flags.go:64] FLAG: --registry-qps="5" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901975 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901978 2561 flags.go:64] FLAG: --reserved-memory="" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901981 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901986 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901988 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901991 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901994 2561 flags.go:64] FLAG: --runonce="false" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.901997 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902000 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902003 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902006 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902009 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902012 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 16:03:40.956378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902015 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902018 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902021 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902023 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902026 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902029 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902032 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902035 2561 flags.go:64] FLAG: --system-cgroups="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902039 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902044 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902047 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902050 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902054 2561 flags.go:64] FLAG: --tls-min-version="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902057 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902060 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902063 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902066 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902068 2561 flags.go:64] FLAG: --v="2" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902072 2561 flags.go:64] FLAG: --version="false" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902076 2561 flags.go:64] FLAG: --vmodule="" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902079 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.902082 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902187 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902190 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902193 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:03:41.054219 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902196 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:03:40.967907 ip-10-0-129-222 systemd[1]: Started Kubernetes Kubelet. Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902198 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902201 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902204 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902206 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902209 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902212 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902214 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902217 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902219 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902223 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902226 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902228 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902231 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902234 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902240 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902243 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902246 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902248 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902251 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:03:41.055118 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902253 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902256 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902258 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902261 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902264 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902266 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902269 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902271 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902274 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902277 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902280 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902283 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902285 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902288 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902290 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902293 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902311 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902315 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902319 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902322 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:03:41.055992 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902325 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902328 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902331 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902334 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902337 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902340 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902354 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902359 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902362 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902365 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902369 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902372 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902375 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902378 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902381 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902383 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902386 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902389 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902391 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:03:41.056803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902393 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902396 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902400 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902403 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902405 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902408 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902411 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902413 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902416 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902419 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902421 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902424 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902426 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902429 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902431 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902434 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902436 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902442 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902445 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902448 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:03:41.057395 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902452 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902456 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902460 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902463 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902465 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902468 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902471 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902473 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902476 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902478 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902481 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902483 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902486 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902488 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902493 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902496 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:03:41.058033 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.902498 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.903105 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.911909 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.911924 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.911938 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.911944 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.911999 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912004 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912007 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912011 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912013 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912017 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912019 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912022 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912025 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:03:41.058551 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912027 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912035 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912038 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912041 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912054 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912059 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912063 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912066 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912069 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912072 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912075 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912077 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912080 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912083 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912085 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912088 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912092 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912095 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912104 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:03:41.059040 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912106 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912109 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912112 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912116 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912119 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912122 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912125 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912128 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912131 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912134 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912137 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912140 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912142 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912145 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912151 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912153 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912156 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912159 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912162 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:03:41.059604 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912165 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912167 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912171 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912175 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912178 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912181 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912183 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912186 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912189 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912191 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912196 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912198 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912201 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912203 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912206 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912209 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912211 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912214 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912216 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912219 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:03:41.062879 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912222 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912224 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912227 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912229 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912232 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912234 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912237 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912241 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912244 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912247 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912249 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912252 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912255 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912258 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912260 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912263 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912265 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912268 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912270 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:03:41.063658 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912273 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912275 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912278 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912283 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912285 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912288 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912291 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912293 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912296 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912298 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912301 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912303 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912306 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.912311 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912441 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:03:41.064249 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912447 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912451 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912454 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912457 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912459 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912463 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912466 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912469 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912472 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912474 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912477 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912480 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912483 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912486 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912488 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912491 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912493 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912496 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912498 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912501 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:03:41.064727 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912503 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912509 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912512 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912515 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912517 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912520 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912522 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912525 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912527 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912530 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912532 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912535 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912538 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912540 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912543 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912545 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912548 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912552 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912554 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:03:41.065277 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912557 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912559 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912562 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912564 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912567 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912570 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912573 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912576 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912578 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912581 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912583 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912586 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912588 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912591 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912596 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912600 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912603 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912606 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912609 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:03:41.065801 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912611 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912614 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912617 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912620 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912622 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912626 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912629 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912632 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912635 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912637 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912640 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912643 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912646 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912649 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912651 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912654 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912657 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912661 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912663 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:03:41.066340 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912668 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912670 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912673 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912676 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912679 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912681 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912684 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912687 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912691 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912693 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912696 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912699 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912701 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912704 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912706 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912709 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912712 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912714 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912717 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912719 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:03:41.066872 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:40.912722 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.912727 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.912833 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.915535 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.916796 2561 server.go:1019] "Starting client certificate rotation" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.916894 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.916932 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.919114 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.920232 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.931841 2561 log.go:25] "Validated CRI v1 runtime API" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.934170 2561 log.go:25] "Validated CRI v1 image API" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.935325 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 16:03:41.067471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.939157 2561 fs.go:135] Filesystem UUIDs: map[516300e5-7f4c-4112-9239-6da8555c67b0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9be48b16-cec2-4196-ae6a-d6cca69ad64a:/dev/nvme0n1p4] Jul 20 16:03:41.067812 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.939181 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 16:03:41.067812 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.941648 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.946493 2561 manager.go:216] Machine: {Timestamp:2026-07-20 16:03:40.945131206 +0000 UTC m=+0.332289706 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095380 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2db158c8cf63a21c9b35a6c3e7e2ca SystemUUID:ec2db158-c8cf-63a2-1c9b-35a6c3e7e2ca BootID:f5d0ef33-bcfe-4691-b417-664b7a12bfcf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:25:14:94:50:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:25:14:94:50:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:11:d6:2e:11:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.946647 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.946716 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.950244 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.950438 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.951079 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.951090 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.951097 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.951852 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.953057 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.955896 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956009 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956037 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956053 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956068 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956078 2561 kubelet.go:398] "Adding apiserver pod source" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956088 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 16:03:41.068270 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956440 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.956461 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.958632 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.960564 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.960591 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961661 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961674 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961680 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961686 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961695 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961701 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961709 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961715 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961721 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961728 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961741 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.961747 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.964141 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.964148 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.965484 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p4f4h" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.967202 2561 server.go:1268] "Started kubelet" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:40.967199 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.967207 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.967297 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.967325 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.967394 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:40.967472 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.968294 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p4f4h" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.969971 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.972292 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:40.972542 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-222.ec2.internal.18c40af9f1e79be3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-222.ec2.internal,UID:ip-10-0-129-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-222.ec2.internal,},FirstTimestamp:2026-07-20 16:03:40.967181283 +0000 UTC m=+0.354339786,LastTimestamp:2026-07-20 16:03:40.967181283 +0000 UTC m=+0.354339786,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-222.ec2.internal,}" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:40.974512 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.978573 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.978577 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:40.978647 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979110 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979113 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979132 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979319 2561 factory.go:55] Registering systemd factory Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979333 2561 factory.go:223] Registration of the systemd container factory successfully Jul 20 16:03:41.200090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979535 2561 factory.go:153] Registering CRI-O factory Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979546 2561 factory.go:223] Registration of the crio container factory successfully Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979593 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979616 2561 factory.go:103] Registering Raw factory Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979630 2561 manager.go:1196] Started watching for new ooms in manager Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.979979 2561 manager.go:349] Starting recovery of all containers Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.980062 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.980081 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.981900 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.995298 2561 manager.go:354] Recovery completed Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:40.999387 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:40.999698 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-222.ec2.internal\" not found" node="ip-10-0-129-222.ec2.internal" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001062 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001092 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001105 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001530 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001541 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001547 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.001561 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.002144 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.002168 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.002178 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.002978 2561 policy_none.go:49] "None policy: Start" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.002990 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.003001 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.004025 2561 policy_none.go:47] "Start" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.050977 2561 manager.go:337] "Starting Device Plugin manager" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:41.051022 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.051035 2561 server.go:87] "Starting device plugin registration server" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.051294 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.051308 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.051506 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.051603 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.051615 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:41.052026 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:41.052086 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.151545 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.152705 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.152729 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.152738 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.152764 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-222.ec2.internal" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.158807 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-222.ec2.internal" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:41.158827 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-222.ec2.internal\": node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:41.185835 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.188608 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.189805 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.189844 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.189865 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:41.189905 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 16:03:41.216235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:41.192556 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:42.610260 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.613398 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal"] Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.613457 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.615476 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.615508 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.615518 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.616723 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.616858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.616884 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.617439 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.617456 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.617478 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.617488 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.617461 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.617539 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.618722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.618750 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.623901 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.623923 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.623932 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:42.642642 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-222.ec2.internal\" not found" node="ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.680381 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:42.647016 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-222.ec2.internal\" not found" node="ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:42.710353 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.710420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/36e3f13071d6e65e613de042ac860efb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-222.ec2.internal\" (UID: \"36e3f13071d6e65e613de042ac860efb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.710442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e78171e635c39c51a4e32f6d6550f553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e78171e635c39c51a4e32f6d6550f553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.710461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e78171e635c39c51a4e32f6d6550f553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e78171e635c39c51a4e32f6d6550f553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:42.810969 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.810996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e78171e635c39c51a4e32f6d6550f553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e78171e635c39c51a4e32f6d6550f553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.811025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e78171e635c39c51a4e32f6d6550f553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e78171e635c39c51a4e32f6d6550f553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.811042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/36e3f13071d6e65e613de042ac860efb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-222.ec2.internal\" (UID: \"36e3f13071d6e65e613de042ac860efb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.811090 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e78171e635c39c51a4e32f6d6550f553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e78171e635c39c51a4e32f6d6550f553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.811102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e78171e635c39c51a4e32f6d6550f553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e78171e635c39c51a4e32f6d6550f553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:42.853603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.811188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/36e3f13071d6e65e613de042ac860efb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-222.ec2.internal\" (UID: \"36e3f13071d6e65e613de042ac860efb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 20 16:03:43.010120 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:42.911326 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.010120 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.946504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:43.010120 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:42.949580 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 20 16:03:43.166261 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.012080 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.166261 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.112419 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.308388 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.212767 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.308388 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.238913 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 16:03:43.308388 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.239037 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:03:43.308388 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.239063 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:03:43.308388 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.299016 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 15:58:42 +0000 UTC" deadline="2028-04-07 22:12:59.601953714 +0000 UTC" Jul 20 16:03:43.308388 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.299035 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15054h9m16.302921024s" Jul 20 16:03:43.313364 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.313051 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.441371 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.359021 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:03:43.441371 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.413377 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.527103 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.513766 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.660318 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:43.562856 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78171e635c39c51a4e32f6d6550f553.slice/crio-e151419f6e7c612ce7dbd8e0ea6376175787f79ac6755996f6861c1540e4daf8 WatchSource:0}: Error finding container e151419f6e7c612ce7dbd8e0ea6376175787f79ac6755996f6861c1540e4daf8: Status 404 returned error can't find the container with id e151419f6e7c612ce7dbd8e0ea6376175787f79ac6755996f6861c1540e4daf8 Jul 20 16:03:43.660318 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:43.563351 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e3f13071d6e65e613de042ac860efb.slice/crio-d13d039d200c98e723a264526f24bd9c4d43cee1a810e1040bf96a8729eaa11d WatchSource:0}: Error finding container d13d039d200c98e723a264526f24bd9c4d43cee1a810e1040bf96a8729eaa11d: Status 404 returned error can't find the container with id d13d039d200c98e723a264526f24bd9c4d43cee1a810e1040bf96a8729eaa11d Jul 20 16:03:43.660318 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.567194 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:03:43.660318 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.614243 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.804943 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.714549 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.950448 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:43.815229 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 20 16:03:43.950448 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.842126 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:03:43.950448 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.901893 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 20 16:03:43.950448 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.911910 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:03:43.950448 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.912960 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 20 16:03:43.950448 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:43.920047 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:03:44.185108 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.185083 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:03:44.280010 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.279984 2561 apiserver.go:52] "Watching apiserver" Jul 20 16:03:44.289205 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.289180 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 16:03:44.289782 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.289754 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal","openshift-multus/multus-z48tq","openshift-network-operator/iptables-alerter-8kdtd","openshift-ovn-kubernetes/ovnkube-node-wbgnt","kube-system/konnectivity-agent-vp7f2","kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6","openshift-cluster-node-tuning-operator/tuned-dbfgg","openshift-dns/node-resolver-49smd","openshift-multus/multus-additional-cni-plugins-64qsf","openshift-multus/network-metrics-daemon-bq6w5","openshift-network-diagnostics/network-check-target-5vtwc","kube-system/global-pull-secret-syncer-lg4gm","openshift-image-registry/node-ca-8jpp7"] Jul 20 16:03:44.292022 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.291382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.293126 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.292858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.293126 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.292934 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:44.294875 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.293582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hrnns\"" Jul 20 16:03:44.294875 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.293804 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.294875 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.294380 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.294875 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.294384 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 16:03:44.294875 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.294575 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.298976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.297310 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.298976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.297498 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.298976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.297678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jwn5x\"" Jul 20 16:03:44.298976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.298270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.298976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.298353 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 16:03:44.299275 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.299116 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.300660 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.300096 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.300660 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.300211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.300660 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.300622 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 16:03:44.301335 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301088 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 16:03:44.301428 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301684 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r97gq\"" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301811 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301897 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.301907 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.302062 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 16:03:44.302734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.302204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.303102 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.302813 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.303102 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.302876 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 16:03:44.303102 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.302978 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b6clx\"" Jul 20 16:03:44.303266 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.303230 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.303452 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.303336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.304960 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.304372 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.304960 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.304580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.304960 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.304710 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m4hwg\"" Jul 20 16:03:44.304960 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.304904 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m2mv8\"" Jul 20 16:03:44.306611 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.306365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.307862 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.307232 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rmmkm\"" Jul 20 16:03:44.307862 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.307478 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.308002 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.307872 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.308427 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.308378 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 16:03:44.308427 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.308401 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 16:03:44.308978 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.308759 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 16:03:44.308978 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.308772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.308978 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.308803 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 16:03:44.309444 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.309309 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggdh9\"" Jul 20 16:03:44.309781 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.309563 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:44.309781 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.309639 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:44.310793 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.310774 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 16:03:44.311450 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.311408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:44.311536 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.311495 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:44.311780 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.311724 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 16:03:44.311780 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.311747 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r6762\"" Jul 20 16:03:44.317214 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3ffed43-61eb-4e98-bff8-c881759893af-iptables-alerter-script\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.317316 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvxs\" (UniqueName: \"kubernetes.io/projected/f3ffed43-61eb-4e98-bff8-c881759893af-kube-api-access-sgvxs\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.317316 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4879f980-bdcd-4812-8ec3-3d827720ef34-hosts-file\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.317418 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b80ed257-9e45-4dd1-8aa6-50ce830b110a-kubelet-config\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.317418 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-socket-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.317514 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.317514 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbscq\" (UniqueName: \"kubernetes.io/projected/c7e40387-c86e-4a85-89e3-98532fb247a5-kube-api-access-pbscq\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.317514 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysctl-conf\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.317654 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-systemd\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.317654 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clpg\" (UniqueName: \"kubernetes.io/projected/e02403fa-5b38-4044-92da-80c18792e936-kube-api-access-6clpg\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.317654 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-slash\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.317796 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317641 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-device-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.317796 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.317796 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-sys-fs\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.317796 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-lib-modules\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.317982 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-sys\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.317982 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-log-socket\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.317982 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317892 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e40387-c86e-4a85-89e3-98532fb247a5-ovn-node-metrics-cert\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.317982 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e02403fa-5b38-4044-92da-80c18792e936-host\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.317982 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysctl-d\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.317982 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.317965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-kubelet\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318287 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-run-netns\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318287 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318287 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318225 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:03:44.318287 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-cni-bin\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318287 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-tuned\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-cni-netd\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e02403fa-5b38-4044-92da-80c18792e936-serviceca\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-kubernetes\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-tmp\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-systemd-units\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-modprobe-d\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.318539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng9s2\" (UniqueName: \"kubernetes.io/projected/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-kube-api-access-ng9s2\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3ffed43-61eb-4e98-bff8-c881759893af-host-slash\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4879f980-bdcd-4812-8ec3-3d827720ef34-tmp-dir\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-systemd\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-env-overrides\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b80ed257-9e45-4dd1-8aa6-50ce830b110a-dbus\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-ovnkube-config\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-var-lib-kubelet\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-ovnkube-script-lib\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stvg\" (UniqueName: \"kubernetes.io/projected/4879f980-bdcd-4812-8ec3-3d827720ef34-kube-api-access-8stvg\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-registration-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fb6m\" (UniqueName: \"kubernetes.io/projected/8394a402-3a19-4295-a492-013903fcf8f9-kube-api-access-2fb6m\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.318911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-etc-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-ovn\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-node-log\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.318981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7cf47b8-96c8-4032-94a6-e51eff1bdc8d-konnectivity-ca\") pod \"konnectivity-agent-vp7f2\" (UID: \"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d\") " pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.319003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-host\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.319027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-var-lib-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.319077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7cf47b8-96c8-4032-94a6-e51eff1bdc8d-agent-certs\") pod \"konnectivity-agent-vp7f2\" (UID: \"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d\") " pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.319099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysconfig\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.319613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.319125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-run\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.341612 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.341573 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc4lj" Jul 20 16:03:44.348379 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.348358 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc4lj" Jul 20 16:03:44.403368 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.403348 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 16:03:44.419739 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-sys\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.419850 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-system-cni-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.419850 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f88379f-4b83-4051-9037-b98682fbf8fd-cni-binary-copy\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.419850 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419821 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-sys\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.419850 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-kubelet\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.420158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt2tf\" (UniqueName: \"kubernetes.io/projected/e9845eca-9a3a-4759-858c-840cbf55eb8f-kube-api-access-gt2tf\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.420158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-log-socket\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.419965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e40387-c86e-4a85-89e3-98532fb247a5-ovn-node-metrics-cert\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420021 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-log-socket\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e02403fa-5b38-4044-92da-80c18792e936-host\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.420158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysctl-d\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.420435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420187 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e02403fa-5b38-4044-92da-80c18792e936-host\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.420435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.420435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420262 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysctl-d\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.420435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-kubelet\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-run-netns\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-cni-bin\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-cni-multus\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-system-cni-dir\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420521 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-kubelet\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420533 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420561 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420594 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-run-netns\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-tuned\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-cni-bin\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-cni-netd\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.420747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-cni-netd\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e02403fa-5b38-4044-92da-80c18792e936-serviceca\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-kubernetes\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-tmp\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-os-release\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-kubernetes\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420992 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-systemd-units\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.420954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-systemd-units\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-modprobe-d\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9s2\" (UniqueName: \"kubernetes.io/projected/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-kube-api-access-ng9s2\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.421303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-cni-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-modprobe-d\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-hostroot\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421499 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e02403fa-5b38-4044-92da-80c18792e936-serviceca\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3ffed43-61eb-4e98-bff8-c881759893af-host-slash\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4879f980-bdcd-4812-8ec3-3d827720ef34-tmp-dir\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421606 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3ffed43-61eb-4e98-bff8-c881759893af-host-slash\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-systemd\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.421770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421739 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-env-overrides\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.421820 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.421900 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4879f980-bdcd-4812-8ec3-3d827720ef34-tmp-dir\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.421956 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:03:44.921901843 +0000 UTC m=+2.986273085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-multus-certs\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-etc-kubernetes\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b80ed257-9e45-4dd1-8aa6-50ce830b110a-dbus\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-ovnkube-config\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-var-lib-kubelet\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422181 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-env-overrides\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.422272 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-cnibin\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.423468 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.423445 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b80ed257-9e45-4dd1-8aa6-50ce830b110a-dbus\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.424367 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.424124 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-ovnkube-config\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.424367 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.424224 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-var-lib-kubelet\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.424367 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.424262 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-systemd\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.424874 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.424850 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e40387-c86e-4a85-89e3-98532fb247a5-ovn-node-metrics-cert\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425155 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.422216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.425229 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-ovnkube-script-lib\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425229 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-tuned\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.425229 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-socket-dir-parent\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.425378 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-conf-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.425433 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-daemon-config\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.425486 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-cnibin\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.425486 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stvg\" (UniqueName: \"kubernetes.io/projected/4879f980-bdcd-4812-8ec3-3d827720ef34-kube-api-access-8stvg\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.425584 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-registration-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.425584 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fb6m\" (UniqueName: \"kubernetes.io/projected/8394a402-3a19-4295-a492-013903fcf8f9-kube-api-access-2fb6m\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.425676 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-etc-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425676 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-ovn\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-node-log\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7cf47b8-96c8-4032-94a6-e51eff1bdc8d-konnectivity-ca\") pod \"konnectivity-agent-vp7f2\" (UID: \"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d\") " pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.425774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e40387-c86e-4a85-89e3-98532fb247a5-ovnkube-script-lib\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-k8s-cni-cncf-io\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.425963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-host\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.425963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425808 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-registration-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.425963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-var-lib-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.425963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7cf47b8-96c8-4032-94a6-e51eff1bdc8d-agent-certs\") pod \"konnectivity-agent-vp7f2\" (UID: \"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d\") " pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.425963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysconfig\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-run\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.425994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3ffed43-61eb-4e98-bff8-c881759893af-iptables-alerter-script\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426029 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-tmp\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvxs\" (UniqueName: \"kubernetes.io/projected/f3ffed43-61eb-4e98-bff8-c881759893af-kube-api-access-sgvxs\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426146 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-etc-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4879f980-bdcd-4812-8ec3-3d827720ef34-hosts-file\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.426220 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b80ed257-9e45-4dd1-8aa6-50ce830b110a-kubelet-config\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-socket-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426405 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7cf47b8-96c8-4032-94a6-e51eff1bdc8d-konnectivity-ca\") pod \"konnectivity-agent-vp7f2\" (UID: \"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d\") " pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbscq\" (UniqueName: \"kubernetes.io/projected/c7e40387-c86e-4a85-89e3-98532fb247a5-kube-api-access-pbscq\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysctl-conf\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426589 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426589 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-host\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-systemd\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426637 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-node-log\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426661 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-systemd\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-cni-bin\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckq4b\" (UniqueName: \"kubernetes.io/projected/1f88379f-4b83-4051-9037-b98682fbf8fd-kube-api-access-ckq4b\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clpg\" (UniqueName: \"kubernetes.io/projected/e02403fa-5b38-4044-92da-80c18792e936-kube-api-access-6clpg\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-os-release\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-slash\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-netns\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426842 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4879f980-bdcd-4812-8ec3-3d827720ef34-hosts-file\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-device-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-device-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.426929 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-sys-fs\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-lib-modules\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426980 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.426996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4r7\" (UniqueName: \"kubernetes.io/projected/03a12d1b-e902-413a-85aa-079bb7f165be-kube-api-access-sg4r7\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-run\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427224 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysconfig\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b80ed257-9e45-4dd1-8aa6-50ce830b110a-kubelet-config\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427388 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-etc-sysctl-conf\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427408 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3ffed43-61eb-4e98-bff8-c881759893af-iptables-alerter-script\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.427616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-socket-dir\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.428015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427648 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-run-ovn\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.428015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427712 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-var-lib-openvswitch\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.428015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427774 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-sys-fs\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.428015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.427874 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-lib-modules\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.428234 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.428046 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e40387-c86e-4a85-89e3-98532fb247a5-host-slash\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.428234 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.428111 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8394a402-3a19-4295-a492-013903fcf8f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.429789 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.429664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7cf47b8-96c8-4032-94a6-e51eff1bdc8d-agent-certs\") pod \"konnectivity-agent-vp7f2\" (UID: \"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d\") " pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.433750 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.433694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng9s2\" (UniqueName: \"kubernetes.io/projected/bddf6856-69a8-4f33-8625-2c9b5aa3ae33-kube-api-access-ng9s2\") pod \"tuned-dbfgg\" (UID: \"bddf6856-69a8-4f33-8625-2c9b5aa3ae33\") " pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.433952 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.433905 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvxs\" (UniqueName: \"kubernetes.io/projected/f3ffed43-61eb-4e98-bff8-c881759893af-kube-api-access-sgvxs\") pod \"iptables-alerter-8kdtd\" (UID: \"f3ffed43-61eb-4e98-bff8-c881759893af\") " pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.435772 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.435704 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stvg\" (UniqueName: \"kubernetes.io/projected/4879f980-bdcd-4812-8ec3-3d827720ef34-kube-api-access-8stvg\") pod \"node-resolver-49smd\" (UID: \"4879f980-bdcd-4812-8ec3-3d827720ef34\") " pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.435772 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.435741 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fb6m\" (UniqueName: \"kubernetes.io/projected/8394a402-3a19-4295-a492-013903fcf8f9-kube-api-access-2fb6m\") pod \"aws-ebs-csi-driver-node-mksz6\" (UID: \"8394a402-3a19-4295-a492-013903fcf8f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.435942 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.435921 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clpg\" (UniqueName: \"kubernetes.io/projected/e02403fa-5b38-4044-92da-80c18792e936-kube-api-access-6clpg\") pod \"node-ca-8jpp7\" (UID: \"e02403fa-5b38-4044-92da-80c18792e936\") " pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.436267 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.436232 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbscq\" (UniqueName: \"kubernetes.io/projected/c7e40387-c86e-4a85-89e3-98532fb247a5-kube-api-access-pbscq\") pod \"ovnkube-node-wbgnt\" (UID: \"c7e40387-c86e-4a85-89e3-98532fb247a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.517500 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.517448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" event={"ID":"e78171e635c39c51a4e32f6d6550f553","Type":"ContainerStarted","Data":"e151419f6e7c612ce7dbd8e0ea6376175787f79ac6755996f6861c1540e4daf8"} Jul 20 16:03:44.518479 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.518454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" event={"ID":"36e3f13071d6e65e613de042ac860efb","Type":"ContainerStarted","Data":"d13d039d200c98e723a264526f24bd9c4d43cee1a810e1040bf96a8729eaa11d"} Jul 20 16:03:44.527784 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4r7\" (UniqueName: \"kubernetes.io/projected/03a12d1b-e902-413a-85aa-079bb7f165be-kube-api-access-sg4r7\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:44.527898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-system-cni-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.527898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f88379f-4b83-4051-9037-b98682fbf8fd-cni-binary-copy\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.527898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-kubelet\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.527898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt2tf\" (UniqueName: \"kubernetes.io/projected/e9845eca-9a3a-4759-858c-840cbf55eb8f-kube-api-access-gt2tf\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.527898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-system-cni-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-cni-multus\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-system-cni-dir\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.527969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-os-release\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-cni-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-hostroot\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528106 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-kubelet\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528171 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-multus-certs\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-etc-kubernetes\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-cnibin\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-socket-dir-parent\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-conf-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-daemon-config\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f88379f-4b83-4051-9037-b98682fbf8fd-cni-binary-copy\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528425 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-os-release\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-etc-kubernetes\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-cnibin\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528527 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-cni-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-k8s-cni-cncf-io\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-k8s-cni-cncf-io\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.528642 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-hostroot\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-cni-bin\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-multus-certs\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq4b\" (UniqueName: \"kubernetes.io/projected/1f88379f-4b83-4051-9037-b98682fbf8fd-kube-api-access-ckq4b\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.528704 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528713 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-cnibin\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-os-release\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-netns\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528787 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-daemon-config\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.528805 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:03:45.028786086 +0000 UTC m=+3.093157315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528879 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528885 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-socket-dir-parent\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528908 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-cni-multus\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528942 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-system-cni-dir\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-cnibin\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528962 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-multus-conf-dir\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.528690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.529380 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.529023 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-var-lib-cni-bin\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.530077 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.529035 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f88379f-4b83-4051-9037-b98682fbf8fd-host-run-netns\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.530077 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.529072 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9845eca-9a3a-4759-858c-840cbf55eb8f-os-release\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.530077 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.529309 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.530077 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.529725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9845eca-9a3a-4759-858c-840cbf55eb8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.536016 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.535980 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:03:44.536016 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.536006 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:03:44.536201 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.536022 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:44.536201 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.536080 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:45.036064734 +0000 UTC m=+3.100435961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:44.538415 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.538388 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4r7\" (UniqueName: \"kubernetes.io/projected/03a12d1b-e902-413a-85aa-079bb7f165be-kube-api-access-sg4r7\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:44.539316 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.539296 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt2tf\" (UniqueName: \"kubernetes.io/projected/e9845eca-9a3a-4759-858c-840cbf55eb8f-kube-api-access-gt2tf\") pod \"multus-additional-cni-plugins-64qsf\" (UID: \"e9845eca-9a3a-4759-858c-840cbf55eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.539423 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.539337 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckq4b\" (UniqueName: \"kubernetes.io/projected/1f88379f-4b83-4051-9037-b98682fbf8fd-kube-api-access-ckq4b\") pod \"multus-z48tq\" (UID: \"1f88379f-4b83-4051-9037-b98682fbf8fd\") " pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.610970 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.610805 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" Jul 20 16:03:44.619864 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.619842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8kdtd" Jul 20 16:03:44.622983 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.622965 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:03:44.630765 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.630745 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:03:44.636430 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.636408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:03:44.644074 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.644047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8jpp7" Jul 20 16:03:44.651718 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.651689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49smd" Jul 20 16:03:44.659833 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.659818 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" Jul 20 16:03:44.667462 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.667446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z48tq" Jul 20 16:03:44.672166 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.672147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64qsf" Jul 20 16:03:44.930897 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:44.930812 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:44.931035 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.931013 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:44.931108 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:44.931096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:03:45.931075323 +0000 UTC m=+3.995446564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:45.031671 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.031644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:45.031840 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.031817 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:45.031914 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.031898 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:03:46.031877414 +0000 UTC m=+4.096248642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:45.132345 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.132303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:45.132502 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.132448 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:03:45.132502 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.132464 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:03:45.132502 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.132474 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:45.132614 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.132533 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:46.132508481 +0000 UTC m=+4.196879705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:45.350731 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.350651 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:58:44 +0000 UTC" deadline="2028-02-15 15:22:38.855111933 +0000 UTC" Jul 20 16:03:45.350731 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.350689 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13799h18m53.504428187s" Jul 20 16:03:45.505615 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:45.505530 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f88379f_4b83_4051_9037_b98682fbf8fd.slice/crio-43b6123af316d7fcf57da70a6671c8d8c24e0cc2db4ff038b898075068a8f1e6 WatchSource:0}: Error finding container 43b6123af316d7fcf57da70a6671c8d8c24e0cc2db4ff038b898075068a8f1e6: Status 404 returned error can't find the container with id 43b6123af316d7fcf57da70a6671c8d8c24e0cc2db4ff038b898075068a8f1e6 Jul 20 16:03:45.509616 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:45.509356 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ffed43_61eb_4e98_bff8_c881759893af.slice/crio-f52295e3d661a1e259cc0bcbc0c1e97b90c547192c2c8da0bd40cf2dc5527c2f WatchSource:0}: Error finding container f52295e3d661a1e259cc0bcbc0c1e97b90c547192c2c8da0bd40cf2dc5527c2f: Status 404 returned error can't find the container with id f52295e3d661a1e259cc0bcbc0c1e97b90c547192c2c8da0bd40cf2dc5527c2f Jul 20 16:03:45.511283 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:45.511171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9845eca_9a3a_4759_858c_840cbf55eb8f.slice/crio-8b19bab46575510f582eebc400505a17b2ba6bdd5af191f7e9dbaa687dccd2e0 WatchSource:0}: Error finding container 8b19bab46575510f582eebc400505a17b2ba6bdd5af191f7e9dbaa687dccd2e0: Status 404 returned error can't find the container with id 8b19bab46575510f582eebc400505a17b2ba6bdd5af191f7e9dbaa687dccd2e0 Jul 20 16:03:45.512586 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:45.512562 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e40387_c86e_4a85_89e3_98532fb247a5.slice/crio-5c0ad8e3f8e47cfd6ed1e87a27f60b7f33e19305fe1d66b3fe5697a51ab0eec7 WatchSource:0}: Error finding container 5c0ad8e3f8e47cfd6ed1e87a27f60b7f33e19305fe1d66b3fe5697a51ab0eec7: Status 404 returned error can't find the container with id 5c0ad8e3f8e47cfd6ed1e87a27f60b7f33e19305fe1d66b3fe5697a51ab0eec7 Jul 20 16:03:45.513123 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.513109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:45.513313 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.513272 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:45.519923 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:03:45.519884 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cf47b8_96c8_4032_94a6_e51eff1bdc8d.slice/crio-90da7e39964122ce4a55ef5d36cd2da65c5ef33c1f2cfc7db39a43bc7e2f9d78 WatchSource:0}: Error finding container 90da7e39964122ce4a55ef5d36cd2da65c5ef33c1f2cfc7db39a43bc7e2f9d78: Status 404 returned error can't find the container with id 90da7e39964122ce4a55ef5d36cd2da65c5ef33c1f2cfc7db39a43bc7e2f9d78 Jul 20 16:03:45.524083 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.524036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" event={"ID":"bddf6856-69a8-4f33-8625-2c9b5aa3ae33","Type":"ContainerStarted","Data":"d2cbd26129fc7ab5c7966385d2aafc7f9c01946c564213463df435742469ec46"} Jul 20 16:03:45.525831 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.525797 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" event={"ID":"8394a402-3a19-4295-a492-013903fcf8f9","Type":"ContainerStarted","Data":"e7d2f5d41db606e476cf0acd27bbb958c110baf41a9aacaaf72f6e278c94da06"} Jul 20 16:03:45.527158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.527122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vp7f2" event={"ID":"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d","Type":"ContainerStarted","Data":"90da7e39964122ce4a55ef5d36cd2da65c5ef33c1f2cfc7db39a43bc7e2f9d78"} Jul 20 16:03:45.528246 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.528214 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49smd" event={"ID":"4879f980-bdcd-4812-8ec3-3d827720ef34","Type":"ContainerStarted","Data":"41b21212e6e64e493128d30af672b60d5b677870eca178c351b3c1d3b814ad96"} Jul 20 16:03:45.529469 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.529447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8jpp7" event={"ID":"e02403fa-5b38-4044-92da-80c18792e936","Type":"ContainerStarted","Data":"e80792bfc016434188d4bc988d2bf7a81839bec0573667ca2fe23614206e44f8"} Jul 20 16:03:45.530665 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.530636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"5c0ad8e3f8e47cfd6ed1e87a27f60b7f33e19305fe1d66b3fe5697a51ab0eec7"} Jul 20 16:03:45.531807 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.531782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerStarted","Data":"8b19bab46575510f582eebc400505a17b2ba6bdd5af191f7e9dbaa687dccd2e0"} Jul 20 16:03:45.532909 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.532876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8kdtd" event={"ID":"f3ffed43-61eb-4e98-bff8-c881759893af","Type":"ContainerStarted","Data":"f52295e3d661a1e259cc0bcbc0c1e97b90c547192c2c8da0bd40cf2dc5527c2f"} Jul 20 16:03:45.534068 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.534049 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z48tq" event={"ID":"1f88379f-4b83-4051-9037-b98682fbf8fd","Type":"ContainerStarted","Data":"43b6123af316d7fcf57da70a6671c8d8c24e0cc2db4ff038b898075068a8f1e6"} Jul 20 16:03:45.938073 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:45.937221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:45.938073 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.937664 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:45.938073 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:45.937731 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:03:47.937711736 +0000 UTC m=+6.002082970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:46.038395 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.038356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:46.038575 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.038511 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:46.038575 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.038573 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:03:48.038555269 +0000 UTC m=+6.102926497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:46.138781 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.138743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:46.138979 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.138959 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:03:46.139059 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.138987 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:03:46.139059 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.139000 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:46.139186 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.139061 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:48.139040076 +0000 UTC m=+6.203411315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:46.351673 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.351552 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:58:44 +0000 UTC" deadline="2028-02-06 07:24:23.501130346 +0000 UTC" Jul 20 16:03:46.351673 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.351618 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13575h20m37.149517251s" Jul 20 16:03:46.521438 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.520721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:46.521438 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.520839 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:46.521438 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.521272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:46.521438 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:46.521382 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:46.554459 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.554424 2561 generic.go:356] "Generic (PLEG): container finished" podID="e78171e635c39c51a4e32f6d6550f553" containerID="efad2eb32a556107b50edb92248b09aba5b8340beafa29b6923e0bf06f4138c9" exitCode=0 Jul 20 16:03:46.554615 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.554522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" event={"ID":"e78171e635c39c51a4e32f6d6550f553","Type":"ContainerDied","Data":"efad2eb32a556107b50edb92248b09aba5b8340beafa29b6923e0bf06f4138c9"} Jul 20 16:03:46.571243 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.571179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" event={"ID":"36e3f13071d6e65e613de042ac860efb","Type":"ContainerStarted","Data":"f02add639c21a5c7fc135fa49315ae751cd29a8b94d846a2ddd143b1fa4fb4d0"} Jul 20 16:03:46.583742 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:46.583675 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" podStartSLOduration=3.583627216 podStartE2EDuration="3.583627216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:03:46.583424975 +0000 UTC m=+4.647796224" watchObservedRunningTime="2026-07-20 16:03:46.583627216 +0000 UTC m=+4.647998470" Jul 20 16:03:47.513866 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:47.513826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:47.514351 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:47.513970 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:47.609972 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:47.609933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" event={"ID":"e78171e635c39c51a4e32f6d6550f553","Type":"ContainerStarted","Data":"fde05cddbe310452e30fd44425878cdccca6699d79c1b8ca4aaa5ddb9efadacf"} Jul 20 16:03:47.954615 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:47.954543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:47.954776 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:47.954692 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:47.954847 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:47.954795 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:03:51.954762978 +0000 UTC m=+10.019134215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:48.056202 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:48.055418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:48.056202 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.055616 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:48.056202 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.055682 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:03:52.055662611 +0000 UTC m=+10.120033839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:48.157030 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:48.156271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:48.157030 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.156517 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:03:48.157030 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.156542 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:03:48.157030 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.156558 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:48.157030 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.156620 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:52.156601041 +0000 UTC m=+10.220972281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:48.519369 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:48.519336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:48.519827 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.519509 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:48.519944 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:48.519912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:48.520088 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:48.520065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:49.513442 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:49.513413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:49.513642 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:49.513536 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:50.514092 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:50.513730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:50.514092 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:50.513822 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:50.514092 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:50.513960 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:50.514092 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:50.514065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:51.513669 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:51.513552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:51.513917 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:51.513708 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:51.987897 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:51.987821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:51.988369 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:51.987964 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:51.988369 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:51.988041 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:03:59.988021706 +0000 UTC m=+18.052392994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:03:52.088751 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:52.088718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:52.088922 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.088907 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:52.088996 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.088970 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:04:00.088950963 +0000 UTC m=+18.153322194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:03:52.189792 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:52.189656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:52.189952 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.189836 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:03:52.189952 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.189856 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:03:52.189952 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.189867 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:52.189952 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.189923 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:04:00.189906608 +0000 UTC m=+18.254277831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:03:52.514961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:52.514508 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:52.514961 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.514615 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:52.514961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:52.514862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:52.514961 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:52.514958 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:53.513151 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:53.513083 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:53.513726 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:53.513234 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:54.517463 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:54.517430 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:54.517905 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:54.517471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:54.517905 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:54.517554 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:54.517905 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:54.517683 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:55.512867 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:55.512833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:55.513054 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:55.512962 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:56.513911 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:56.513878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:56.514384 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:56.513922 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:56.514384 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:56.514056 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:56.514384 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:56.514319 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:57.513173 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:57.513122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:57.513353 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:57.513249 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:03:58.513939 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:58.513903 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:03:58.514472 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:58.513903 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:03:58.514472 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:58.514032 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:03:58.514472 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:58.514106 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:03:59.513761 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:03:59.513730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:03:59.513959 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:03:59.513840 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:00.046554 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:00.046511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:00.046754 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.046699 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:04:00.046829 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.046776 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:04:16.04675657 +0000 UTC m=+34.111127797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:04:00.147825 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:00.147791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:00.148007 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.147939 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:04:00.148007 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.147993 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:04:16.147979809 +0000 UTC m=+34.212351033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:04:00.249048 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:00.249012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:00.249229 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.249177 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:04:00.249229 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.249199 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:04:00.249229 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.249212 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:04:00.249380 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.249271 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:04:16.249258378 +0000 UTC m=+34.313629603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:04:00.513504 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:00.513426 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:00.513662 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.513567 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:00.513662 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:00.513599 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:00.513766 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:00.513705 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:01.513081 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:01.513042 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:01.513486 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:01.513181 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:02.514395 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:02.514362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:02.514828 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:02.514484 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:02.514828 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:02.514538 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:02.514828 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:02.514638 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:03.513550 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:03.513517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:03.513726 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:03.513638 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:04.513156 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.512965 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:04.513757 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.512991 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:04.513757 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:04.513268 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:04.513757 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:04.513288 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:04.644599 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.644571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49smd" event={"ID":"4879f980-bdcd-4812-8ec3-3d827720ef34","Type":"ContainerStarted","Data":"b6dc22a1dfa715be0603c02196a223782a3247481db43a7e07ea6acca04a39cf"} Jul 20 16:04:04.646576 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.646217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8jpp7" event={"ID":"e02403fa-5b38-4044-92da-80c18792e936","Type":"ContainerStarted","Data":"3be8303f039e694aac73f32458b68636275bcd330aef30aa7ca68271cc66aa4b"} Jul 20 16:04:04.648215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.648197 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:04:04.648527 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.648508 2561 generic.go:356] "Generic (PLEG): container finished" podID="c7e40387-c86e-4a85-89e3-98532fb247a5" containerID="bde97f650d6303c3209af08886a9ff531ee1a94721d1d1f6f8dec527aad2a464" exitCode=1 Jul 20 16:04:04.648598 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.648580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerDied","Data":"bde97f650d6303c3209af08886a9ff531ee1a94721d1d1f6f8dec527aad2a464"} Jul 20 16:04:04.648665 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.648646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"d76c6f19b3661748ee2073ed195a1faf00e3593992ff0ef47a79c32669a612de"} Jul 20 16:04:04.649974 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.649954 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9845eca-9a3a-4759-858c-840cbf55eb8f" containerID="dca24a77133ade6b550090b949234e7c7066d3923f50132c6666578e03d8986a" exitCode=0 Jul 20 16:04:04.650078 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.650032 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerDied","Data":"dca24a77133ade6b550090b949234e7c7066d3923f50132c6666578e03d8986a"} Jul 20 16:04:04.651823 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.651800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z48tq" event={"ID":"1f88379f-4b83-4051-9037-b98682fbf8fd","Type":"ContainerStarted","Data":"b5d6e2e232db3c592335818ddbcdec0672bf527879c931e2253ad4ca1f6a578f"} Jul 20 16:04:04.653531 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.653510 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" event={"ID":"bddf6856-69a8-4f33-8625-2c9b5aa3ae33","Type":"ContainerStarted","Data":"efc4f134f0fe8e9f4dec5df398b40a2cb122181e4c6352a8e52afac30c55c0a7"} Jul 20 16:04:04.655099 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.655077 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" event={"ID":"8394a402-3a19-4295-a492-013903fcf8f9","Type":"ContainerStarted","Data":"afea2f36547439a38d2dfe493ead2c9999121fa0245f2818e17dd0b42c1df6d6"} Jul 20 16:04:04.656632 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.656609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vp7f2" event={"ID":"e7cf47b8-96c8-4032-94a6-e51eff1bdc8d","Type":"ContainerStarted","Data":"7864139b1b9f32df7a97dd3495017d227e6b19ac07f16f2f48d4ed3547ab8092"} Jul 20 16:04:04.657423 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.657378 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" podStartSLOduration=21.657361299 podStartE2EDuration="21.657361299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:03:47.623833866 +0000 UTC m=+5.688205129" watchObservedRunningTime="2026-07-20 16:04:04.657361299 +0000 UTC m=+22.721732540" Jul 20 16:04:04.671884 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.671847 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-49smd" podStartSLOduration=4.035399569 podStartE2EDuration="22.671832913s" totalImagesPullingTime="18.636433344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:04.656981929 +0000 UTC m=+22.721353175" watchObservedRunningTime="2026-07-20 16:04:04.671832913 +0000 UTC m=+22.736204254" Jul 20 16:04:04.672202 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.672173 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z48tq" podStartSLOduration=3.963643048 podStartE2EDuration="22.672165181s" totalImagesPullingTime="18.708522133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:04.671718588 +0000 UTC m=+22.736089834" watchObservedRunningTime="2026-07-20 16:04:04.672165181 +0000 UTC m=+22.736536424" Jul 20 16:04:04.702301 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.702255 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vp7f2" podStartSLOduration=12.421218576 podStartE2EDuration="22.702243821s" totalImagesPullingTime="10.281025245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:04.701928265 +0000 UTC m=+22.766299510" watchObservedRunningTime="2026-07-20 16:04:04.702243821 +0000 UTC m=+22.766615067" Jul 20 16:04:04.717238 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.717190 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8jpp7" podStartSLOduration=4.07642831 podStartE2EDuration="22.71717232s" totalImagesPullingTime="18.64074401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:04.717054342 +0000 UTC m=+22.781425588" watchObservedRunningTime="2026-07-20 16:04:04.71717232 +0000 UTC m=+22.781543579" Jul 20 16:04:04.735497 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:04.735460 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dbfgg" podStartSLOduration=4.099341807 podStartE2EDuration="22.735447569s" totalImagesPullingTime="18.636105762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:04.735394156 +0000 UTC m=+22.799765403" watchObservedRunningTime="2026-07-20 16:04:04.735447569 +0000 UTC m=+22.799818814" Jul 20 16:04:05.513035 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.513006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:05.513263 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:05.513148 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:05.647081 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.647049 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:04:05.647694 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.647675 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:04:05.663274 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.662824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:04:05.663363 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.663334 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"43202a3452133c079ccb9537ad085028e405884d08b5040ce9b4b25b75e37447"} Jul 20 16:04:05.663423 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.663405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"43eb9e635189915b85a587ce7301d648640b83ea56563f7b44574e35dc0d085d"} Jul 20 16:04:05.663478 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.663455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"b1604cf24681f1e4b294e7b7f2939e40ed8841a48cc3dc8ddc53119152cd4db6"} Jul 20 16:04:05.663529 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.663504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"80d2eec5b96275d081e3b0fcaa09ddfb3c0365c9b24e3d08b7f4598cb4014e84"} Jul 20 16:04:05.665223 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.665192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8kdtd" event={"ID":"f3ffed43-61eb-4e98-bff8-c881759893af","Type":"ContainerStarted","Data":"3cfa33e5df2aac23eb16c99a9ab13c5897a8aa8de999110275857c90b780c433"} Jul 20 16:04:05.678359 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.678320 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8kdtd" podStartSLOduration=5.033072057 podStartE2EDuration="23.678305864s" totalImagesPullingTime="18.645233807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:05.67800274 +0000 UTC m=+23.742373986" watchObservedRunningTime="2026-07-20 16:04:05.678305864 +0000 UTC m=+23.742677110" Jul 20 16:04:05.717860 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:05.717825 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 16:04:06.386068 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.385949 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T16:04:05.717845823Z","UUID":"169b4766-2447-4fa1-b287-afb7685e377d","Handler":null,"Name":"","Endpoint":""} Jul 20 16:04:06.387622 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.387600 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 16:04:06.387763 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.387635 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 16:04:06.514538 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.514190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:06.514538 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:06.514335 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:06.514538 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.514393 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:06.514538 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:06.514503 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:06.669267 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.669189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" event={"ID":"8394a402-3a19-4295-a492-013903fcf8f9","Type":"ContainerStarted","Data":"d81da12bf571a2a1af7691ef1dca9afab80a49ec5261ff72d7149c27283567c9"} Jul 20 16:04:06.669267 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:06.669237 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 16:04:07.513761 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:07.513725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:07.514051 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:07.513842 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:07.674926 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:07.674722 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:04:07.675398 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:07.675357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"ea2137dc509c14bc87750435c5cb5a8cfe7961f9f5752ceab9879fe7873453b4"} Jul 20 16:04:07.677646 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:07.677615 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" event={"ID":"8394a402-3a19-4295-a492-013903fcf8f9","Type":"ContainerStarted","Data":"228a60d203a43bb6de0179f4e689cab8c97f7ffd2345bab455614f254520be23"} Jul 20 16:04:07.694478 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:07.694429 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mksz6" podStartSLOduration=4.856623897 podStartE2EDuration="25.694413554s" totalImagesPullingTime="20.837789657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:07.694220315 +0000 UTC m=+25.758591584" watchObservedRunningTime="2026-07-20 16:04:07.694413554 +0000 UTC m=+25.758784801" Jul 20 16:04:08.513414 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:08.513384 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:08.513624 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:08.513525 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:08.513624 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:08.513588 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:08.513720 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:08.513698 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:09.513449 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.513277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:09.514253 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:09.513554 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:09.685067 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.685039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:04:09.685460 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.685437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"f5aef88018732e71b232ffcf18c61c8af0eece60530a3c6603502c19caaa3359"} Jul 20 16:04:09.685758 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.685731 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:04:09.685873 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.685806 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:04:09.685923 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.685909 2561 scope.go:117] "RemoveContainer" containerID="bde97f650d6303c3209af08886a9ff531ee1a94721d1d1f6f8dec527aad2a464" Jul 20 16:04:09.687498 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.687463 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9845eca-9a3a-4759-858c-840cbf55eb8f" containerID="f7c22a29d565b3873878312c8b7ad73dc448c774a1bb27d1889d572371bea3eb" exitCode=0 Jul 20 16:04:09.687769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.687521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerDied","Data":"f7c22a29d565b3873878312c8b7ad73dc448c774a1bb27d1889d572371bea3eb"} Jul 20 16:04:09.702733 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:09.702716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:04:10.514040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.513009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:10.514040 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:10.513151 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:10.514040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.513530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:10.514040 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:10.513650 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:10.693019 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.692994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:04:10.693381 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.693359 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" event={"ID":"c7e40387-c86e-4a85-89e3-98532fb247a5","Type":"ContainerStarted","Data":"118d1141e74332af2e251b0a08bf362dd33115e59ecb0b30ae5d905632f61ef6"} Jul 20 16:04:10.693569 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.693550 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:04:10.708842 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.708820 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:04:10.718189 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:10.718143 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" podStartSLOduration=9.996845564000001 podStartE2EDuration="28.718114727s" totalImagesPullingTime="18.721269163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:10.717458071 +0000 UTC m=+28.781829337" watchObservedRunningTime="2026-07-20 16:04:10.718114727 +0000 UTC m=+28.782485973" Jul 20 16:04:11.340489 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.340449 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg4gm"] Jul 20 16:04:11.340673 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.340607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:11.340722 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:11.340697 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:11.341114 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.341093 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bq6w5"] Jul 20 16:04:11.341224 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.341196 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:11.341337 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:11.341295 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:11.341708 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.341687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5vtwc"] Jul 20 16:04:11.341782 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.341773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:11.341879 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:11.341861 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:11.601101 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.601027 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:04:11.601563 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.601177 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 16:04:11.601677 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.601661 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vp7f2" Jul 20 16:04:11.697365 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.697334 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9845eca-9a3a-4759-858c-840cbf55eb8f" containerID="f9e31149d4c06c7c44e310756b548916f6fc872d234b6a9c1a41838a27724bca" exitCode=0 Jul 20 16:04:11.697530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.697427 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerDied","Data":"f9e31149d4c06c7c44e310756b548916f6fc872d234b6a9c1a41838a27724bca"} Jul 20 16:04:11.999483 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:11.999326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49smd_4879f980-bdcd-4812-8ec3-3d827720ef34/dns-node-resolver/0.log" Jul 20 16:04:12.514001 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:12.513971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:12.514165 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:12.514062 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:12.973009 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:12.972940 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8jpp7_e02403fa-5b38-4044-92da-80c18792e936/node-ca/0.log" Jul 20 16:04:13.513429 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:13.513355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:13.513568 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:13.513456 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:13.513568 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:13.513503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:13.513650 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:13.513574 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:13.705056 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:13.705019 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9845eca-9a3a-4759-858c-840cbf55eb8f" containerID="389e909b37190fffe60fb4235affa854c9dc87c0a086d18091036e3976b6c504" exitCode=0 Jul 20 16:04:13.705230 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:13.705080 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerDied","Data":"389e909b37190fffe60fb4235affa854c9dc87c0a086d18091036e3976b6c504"} Jul 20 16:04:14.513148 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:14.513103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:14.513745 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:14.513258 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:15.513807 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:15.513770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:15.514287 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:15.513946 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:15.514287 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:15.513988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:15.514287 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:15.514089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:16.068481 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:16.068450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:16.068672 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.068561 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:04:16.068672 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.068622 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret podName:b80ed257-9e45-4dd1-8aa6-50ce830b110a nodeName:}" failed. No retries permitted until 2026-07-20 16:04:48.06860417 +0000 UTC m=+66.132975406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret") pod "global-pull-secret-syncer-lg4gm" (UID: "b80ed257-9e45-4dd1-8aa6-50ce830b110a") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:04:16.169524 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:16.169492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:16.169676 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.169658 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:04:16.169745 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.169733 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs podName:03a12d1b-e902-413a-85aa-079bb7f165be nodeName:}" failed. No retries permitted until 2026-07-20 16:04:48.169711278 +0000 UTC m=+66.234082526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs") pod "network-metrics-daemon-bq6w5" (UID: "03a12d1b-e902-413a-85aa-079bb7f165be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:04:16.269792 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:16.269762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:16.269922 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.269907 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:04:16.269983 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.269927 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:04:16.269983 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.269936 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6pzxx for pod openshift-network-diagnostics/network-check-target-5vtwc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:04:16.270055 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.269992 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx podName:9c8dbf78-7129-40b1-b0e4-58c7ad76f843 nodeName:}" failed. No retries permitted until 2026-07-20 16:04:48.269979906 +0000 UTC m=+66.334351134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pzxx" (UniqueName: "kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx") pod "network-check-target-5vtwc" (UID: "9c8dbf78-7129-40b1-b0e4-58c7ad76f843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:04:16.513961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:16.513930 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:16.514426 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:16.514074 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:17.513733 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:17.513697 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:17.513942 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:17.513843 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:17.513942 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:17.513897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:17.514528 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:17.514013 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:18.513539 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:18.513504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:18.513694 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:18.513640 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:18.723407 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:18.723343 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9845eca-9a3a-4759-858c-840cbf55eb8f" containerID="ff7732ea27f6d2d6cf1a99dd434633d335e774069f229710c47a48a65ab8ea91" exitCode=0 Jul 20 16:04:18.723407 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:18.723388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerDied","Data":"ff7732ea27f6d2d6cf1a99dd434633d335e774069f229710c47a48a65ab8ea91"} Jul 20 16:04:19.513200 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:19.513171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:19.513370 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:19.513171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:19.513370 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:19.513281 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:19.513443 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:19.513366 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:19.729217 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:19.729185 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9845eca-9a3a-4759-858c-840cbf55eb8f" containerID="6450acbeec2fd7c8c4219d6fa13cfff9f694e2f99cfc3d226fc2a8a9c5d7efd5" exitCode=0 Jul 20 16:04:19.729609 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:19.729243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerDied","Data":"6450acbeec2fd7c8c4219d6fa13cfff9f694e2f99cfc3d226fc2a8a9c5d7efd5"} Jul 20 16:04:20.514027 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:20.513843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:20.514207 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:20.514110 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:20.734035 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:20.734003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64qsf" event={"ID":"e9845eca-9a3a-4759-858c-840cbf55eb8f","Type":"ContainerStarted","Data":"dd9ca19d009a1d7e677c5d67b3e76d4de04d57feccfbe4395abd8bdb0da38515"} Jul 20 16:04:20.755520 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:20.755470 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-64qsf" podStartSLOduration=8.843930468 podStartE2EDuration="38.755456324s" totalImagesPullingTime="29.911525856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:20.754946941 +0000 UTC m=+38.819318186" watchObservedRunningTime="2026-07-20 16:04:20.755456324 +0000 UTC m=+38.819827569" Jul 20 16:04:21.513052 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:21.513016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:21.513052 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:21.513049 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:21.513285 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:21.513149 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:21.513285 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:21.513245 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:22.517122 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:22.517092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:22.517518 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:22.517206 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:23.513112 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:23.513076 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:23.513305 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:23.513076 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:23.513305 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:23.513200 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:23.513305 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:23.513245 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:24.513226 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:24.513197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:24.513600 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:24.513332 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:25.513234 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:25.513204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:25.513616 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:25.513305 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:25.513616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:25.513362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:25.513616 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:25.513442 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:26.512805 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:26.512772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:26.512956 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:26.512901 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:27.513757 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:27.513730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:27.513757 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:27.513753 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:27.514184 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:27.513821 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:27.514184 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:27.513941 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:28.512927 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:28.512899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:28.513174 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:28.513028 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:29.513252 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:29.513216 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:29.513695 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:29.513217 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:29.513695 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:29.513316 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:29.513695 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:29.513425 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:30.513790 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:30.513761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:30.514154 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:30.513900 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:31.513408 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:31.513377 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:31.513604 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:31.513379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:31.513604 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:31.513512 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4gm" podUID="b80ed257-9e45-4dd1-8aa6-50ce830b110a" Jul 20 16:04:31.513604 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:31.513540 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5vtwc" podUID="9c8dbf78-7129-40b1-b0e4-58c7ad76f843" Jul 20 16:04:32.514678 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.514641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:32.515169 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:32.514763 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bq6w5" podUID="03a12d1b-e902-413a-85aa-079bb7f165be" Jul 20 16:04:32.769383 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.769308 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeReady" Jul 20 16:04:32.769523 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.769440 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 16:04:32.798931 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.798894 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c757d75b8-z9s4r"] Jul 20 16:04:32.805595 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.805575 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.807668 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.807646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hfg29\"" Jul 20 16:04:32.807790 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.807664 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 16:04:32.807790 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.807744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 16:04:32.807790 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.807771 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 16:04:32.809207 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.809182 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q76dr"] Jul 20 16:04:32.812167 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.812148 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 16:04:32.815961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.815942 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j2s45"] Jul 20 16:04:32.816064 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.816050 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.820015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.819702 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 16:04:32.820015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.819728 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 16:04:32.820223 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.820165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 16:04:32.820327 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.820214 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-69h8g\"" Jul 20 16:04:32.820327 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.820230 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 16:04:32.827607 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.827585 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c757d75b8-z9s4r"] Jul 20 16:04:32.827687 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.827624 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q76dr"] Jul 20 16:04:32.827725 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.827705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.829830 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.829810 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 16:04:32.829996 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.829979 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 16:04:32.830065 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.830043 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lstlr\"" Jul 20 16:04:32.835037 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.835017 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j2s45"] Jul 20 16:04:32.894837 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9bxn\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-kube-api-access-n9bxn\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.894837 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk25r\" (UniqueName: \"kubernetes.io/projected/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-kube-api-access-mk25r\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.895040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84ed4e7d-0efa-4422-b022-5668169bfabb-trusted-ca\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.895040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-bound-sa-token\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.895040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894944 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/099e46af-8b56-4761-97f3-c42df0ce3bb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.895040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rbwm\" (UniqueName: \"kubernetes.io/projected/099e46af-8b56-4761-97f3-c42df0ce3bb6-kube-api-access-7rbwm\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.895040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.894994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-metrics-tls\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-tmp-dir\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/099e46af-8b56-4761-97f3-c42df0ce3bb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-registry-tls\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84ed4e7d-0efa-4422-b022-5668169bfabb-ca-trust-extracted\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84ed4e7d-0efa-4422-b022-5668169bfabb-registry-certificates\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/099e46af-8b56-4761-97f3-c42df0ce3bb6-crio-socket\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.895215 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895206 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/099e46af-8b56-4761-97f3-c42df0ce3bb6-data-volume\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.895456 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-config-volume\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.895456 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84ed4e7d-0efa-4422-b022-5668169bfabb-image-registry-private-configuration\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.895456 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.895277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84ed4e7d-0efa-4422-b022-5668169bfabb-installation-pull-secrets\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.915186 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.915150 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6pjbj"] Jul 20 16:04:32.932152 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.932116 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6pjbj"] Jul 20 16:04:32.932277 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.932220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:32.934342 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.934321 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 16:04:32.934496 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.934480 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 16:04:32.934573 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.934528 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 16:04:32.934670 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.934656 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rljs7\"" Jul 20 16:04:32.995904 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.995876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rbwm\" (UniqueName: \"kubernetes.io/projected/099e46af-8b56-4761-97f3-c42df0ce3bb6-kube-api-access-7rbwm\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.996014 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.995910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-metrics-tls\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.996014 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.995980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-tmp-dir\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.996128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/099e46af-8b56-4761-97f3-c42df0ce3bb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.996128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-registry-tls\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.996128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84ed4e7d-0efa-4422-b022-5668169bfabb-ca-trust-extracted\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.996128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84ed4e7d-0efa-4422-b022-5668169bfabb-registry-certificates\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.996128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/099e46af-8b56-4761-97f3-c42df0ce3bb6-crio-socket\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.996365 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996160 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/099e46af-8b56-4761-97f3-c42df0ce3bb6-data-volume\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.996365 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-config-volume\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.996365 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84ed4e7d-0efa-4422-b022-5668169bfabb-image-registry-private-configuration\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.996365 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996247 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/099e46af-8b56-4761-97f3-c42df0ce3bb6-crio-socket\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.996537 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996448 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-tmp-dir\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.996537 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996501 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84ed4e7d-0efa-4422-b022-5668169bfabb-ca-trust-extracted\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.996537 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84ed4e7d-0efa-4422-b022-5668169bfabb-installation-pull-secrets\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.996712 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94173252-79f6-4352-b9d4-e8185121721a-cert\") pod \"ingress-canary-6pjbj\" (UID: \"94173252-79f6-4352-b9d4-e8185121721a\") " pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:32.996712 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5cvq\" (UniqueName: \"kubernetes.io/projected/94173252-79f6-4352-b9d4-e8185121721a-kube-api-access-d5cvq\") pod \"ingress-canary-6pjbj\" (UID: \"94173252-79f6-4352-b9d4-e8185121721a\") " pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:32.996712 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996605 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/099e46af-8b56-4761-97f3-c42df0ce3bb6-data-volume\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.996975 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9bxn\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-kube-api-access-n9bxn\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.997087 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk25r\" (UniqueName: \"kubernetes.io/projected/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-kube-api-access-mk25r\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.997087 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.997032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84ed4e7d-0efa-4422-b022-5668169bfabb-trusted-ca\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.997087 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.997056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-bound-sa-token\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.997087 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.997081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/099e46af-8b56-4761-97f3-c42df0ce3bb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.997299 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.997165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84ed4e7d-0efa-4422-b022-5668169bfabb-registry-certificates\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:32.997299 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.996955 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-config-volume\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:32.997650 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.997626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/099e46af-8b56-4761-97f3-c42df0ce3bb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:32.998050 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:32.998028 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84ed4e7d-0efa-4422-b022-5668169bfabb-trusted-ca\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.000368 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.000350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/099e46af-8b56-4761-97f3-c42df0ce3bb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:33.000511 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.000465 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84ed4e7d-0efa-4422-b022-5668169bfabb-installation-pull-secrets\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.000719 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.000692 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-registry-tls\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.001013 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.000993 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-metrics-tls\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:33.001083 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.001067 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84ed4e7d-0efa-4422-b022-5668169bfabb-image-registry-private-configuration\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.004770 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.004748 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-bound-sa-token\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.004937 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.004921 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk25r\" (UniqueName: \"kubernetes.io/projected/2fd71527-5a1c-4ad1-9212-fd30f3a0a768-kube-api-access-mk25r\") pod \"dns-default-j2s45\" (UID: \"2fd71527-5a1c-4ad1-9212-fd30f3a0a768\") " pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:33.005257 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.005235 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9bxn\" (UniqueName: \"kubernetes.io/projected/84ed4e7d-0efa-4422-b022-5668169bfabb-kube-api-access-n9bxn\") pod \"image-registry-c757d75b8-z9s4r\" (UID: \"84ed4e7d-0efa-4422-b022-5668169bfabb\") " pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.005370 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.005355 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rbwm\" (UniqueName: \"kubernetes.io/projected/099e46af-8b56-4761-97f3-c42df0ce3bb6-kube-api-access-7rbwm\") pod \"insights-runtime-extractor-q76dr\" (UID: \"099e46af-8b56-4761-97f3-c42df0ce3bb6\") " pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:33.097811 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.097749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94173252-79f6-4352-b9d4-e8185121721a-cert\") pod \"ingress-canary-6pjbj\" (UID: \"94173252-79f6-4352-b9d4-e8185121721a\") " pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:33.097811 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.097782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5cvq\" (UniqueName: \"kubernetes.io/projected/94173252-79f6-4352-b9d4-e8185121721a-kube-api-access-d5cvq\") pod \"ingress-canary-6pjbj\" (UID: \"94173252-79f6-4352-b9d4-e8185121721a\") " pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:33.099992 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.099964 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94173252-79f6-4352-b9d4-e8185121721a-cert\") pod \"ingress-canary-6pjbj\" (UID: \"94173252-79f6-4352-b9d4-e8185121721a\") " pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:33.115867 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.115843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.120551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.120534 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5cvq\" (UniqueName: \"kubernetes.io/projected/94173252-79f6-4352-b9d4-e8185121721a-kube-api-access-d5cvq\") pod \"ingress-canary-6pjbj\" (UID: \"94173252-79f6-4352-b9d4-e8185121721a\") " pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:33.128403 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.128363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q76dr" Jul 20 16:04:33.137503 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.137481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:33.240753 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.240724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6pjbj" Jul 20 16:04:33.389818 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.389787 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q76dr"] Jul 20 16:04:33.393794 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:04:33.393762 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099e46af_8b56_4761_97f3_c42df0ce3bb6.slice/crio-ce84e49384dc797e4c55ff3c41b52376fd03bbc503dc942a04de1c412c068827 WatchSource:0}: Error finding container ce84e49384dc797e4c55ff3c41b52376fd03bbc503dc942a04de1c412c068827: Status 404 returned error can't find the container with id ce84e49384dc797e4c55ff3c41b52376fd03bbc503dc942a04de1c412c068827 Jul 20 16:04:33.401454 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.401424 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j2s45"] Jul 20 16:04:33.424976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.424952 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6pjbj"] Jul 20 16:04:33.427843 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:04:33.427818 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94173252_79f6_4352_b9d4_e8185121721a.slice/crio-ab584a6155e2c1a7f2eaf2ce825d2772d3869297b0e6a1b3f49eceef5e040bc9 WatchSource:0}: Error finding container ab584a6155e2c1a7f2eaf2ce825d2772d3869297b0e6a1b3f49eceef5e040bc9: Status 404 returned error can't find the container with id ab584a6155e2c1a7f2eaf2ce825d2772d3869297b0e6a1b3f49eceef5e040bc9 Jul 20 16:04:33.513573 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.513551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:33.513659 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.513551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:33.515863 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.515833 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:04:33.515863 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.515861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:04:33.516285 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.515883 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:04:33.516285 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.515884 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzbbl\"" Jul 20 16:04:33.609050 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.609001 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c757d75b8-z9s4r"] Jul 20 16:04:33.612264 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:04:33.612242 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ed4e7d_0efa_4422_b022_5668169bfabb.slice/crio-9f27f30012d521328f33f31e5be5e12f7d1217e16288dc39a4e7f814480a1c14 WatchSource:0}: Error finding container 9f27f30012d521328f33f31e5be5e12f7d1217e16288dc39a4e7f814480a1c14: Status 404 returned error can't find the container with id 9f27f30012d521328f33f31e5be5e12f7d1217e16288dc39a4e7f814480a1c14 Jul 20 16:04:33.761426 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.761396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q76dr" event={"ID":"099e46af-8b56-4761-97f3-c42df0ce3bb6","Type":"ContainerStarted","Data":"ce84e49384dc797e4c55ff3c41b52376fd03bbc503dc942a04de1c412c068827"} Jul 20 16:04:33.762922 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.762890 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" event={"ID":"84ed4e7d-0efa-4422-b022-5668169bfabb","Type":"ContainerStarted","Data":"d6c57a0c440f57eca7777210cdf3b5311a24d3e2215d14671e61771b110a5e00"} Jul 20 16:04:33.763067 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.762942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:04:33.763067 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.762962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" event={"ID":"84ed4e7d-0efa-4422-b022-5668169bfabb","Type":"ContainerStarted","Data":"9f27f30012d521328f33f31e5be5e12f7d1217e16288dc39a4e7f814480a1c14"} Jul 20 16:04:33.763994 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.763972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6pjbj" event={"ID":"94173252-79f6-4352-b9d4-e8185121721a","Type":"ContainerStarted","Data":"ab584a6155e2c1a7f2eaf2ce825d2772d3869297b0e6a1b3f49eceef5e040bc9"} Jul 20 16:04:33.764922 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.764903 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2s45" event={"ID":"2fd71527-5a1c-4ad1-9212-fd30f3a0a768","Type":"ContainerStarted","Data":"dc64405e29633a7d0b5bddb0e0c1ca80daaf9db9a281678e475db6421099b5b9"} Jul 20 16:04:33.782316 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:33.782248 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" podStartSLOduration=2.782229429 podStartE2EDuration="2.782229429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:33.781760762 +0000 UTC m=+51.846132004" watchObservedRunningTime="2026-07-20 16:04:33.782229429 +0000 UTC m=+51.846600678" Jul 20 16:04:34.513816 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:34.513780 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:34.516901 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:34.516875 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:04:34.517303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:34.517157 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z4c96\"" Jul 20 16:04:35.218105 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.217980 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-d6qxd"] Jul 20 16:04:35.237092 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.237063 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-d6qxd"] Jul 20 16:04:35.237262 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.237204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:04:35.240510 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.239917 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ft6mg\"" Jul 20 16:04:35.240510 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.239996 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 16:04:35.240510 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.240158 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 16:04:35.317650 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.317614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf929\" (UniqueName: \"kubernetes.io/projected/ac59cd04-a40a-4255-8483-fc4a042d2c51-kube-api-access-nf929\") pod \"downloads-5bc67dcd46-d6qxd\" (UID: \"ac59cd04-a40a-4255-8483-fc4a042d2c51\") " pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:04:35.418859 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.418802 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf929\" (UniqueName: \"kubernetes.io/projected/ac59cd04-a40a-4255-8483-fc4a042d2c51-kube-api-access-nf929\") pod \"downloads-5bc67dcd46-d6qxd\" (UID: \"ac59cd04-a40a-4255-8483-fc4a042d2c51\") " pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:04:35.427184 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.427096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf929\" (UniqueName: \"kubernetes.io/projected/ac59cd04-a40a-4255-8483-fc4a042d2c51-kube-api-access-nf929\") pod \"downloads-5bc67dcd46-d6qxd\" (UID: \"ac59cd04-a40a-4255-8483-fc4a042d2c51\") " pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:04:35.549849 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:35.549820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:04:40.340833 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.340804 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-d6qxd"] Jul 20 16:04:40.344361 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:04:40.344329 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac59cd04_a40a_4255_8483_fc4a042d2c51.slice/crio-b2d6c25248b1a9c47c98d0f3a419ec5b7a9f27e5b1dc4e32a75025c44486f6ed WatchSource:0}: Error finding container b2d6c25248b1a9c47c98d0f3a419ec5b7a9f27e5b1dc4e32a75025c44486f6ed: Status 404 returned error can't find the container with id b2d6c25248b1a9c47c98d0f3a419ec5b7a9f27e5b1dc4e32a75025c44486f6ed Jul 20 16:04:40.786259 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.786224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6pjbj" event={"ID":"94173252-79f6-4352-b9d4-e8185121721a","Type":"ContainerStarted","Data":"50c9b7bda3bcc165e65ce45e57eaf635a358e49e35eb6aa60048d733dad90ce8"} Jul 20 16:04:40.787892 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.787862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2s45" event={"ID":"2fd71527-5a1c-4ad1-9212-fd30f3a0a768","Type":"ContainerStarted","Data":"1772e8d79f51a17b31d64c9293ce9c3bbef26ce3c24e6fb7f645077003f489cf"} Jul 20 16:04:40.788024 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.787916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2s45" event={"ID":"2fd71527-5a1c-4ad1-9212-fd30f3a0a768","Type":"ContainerStarted","Data":"b5e01115a8a82185384bfac4b5261bc9412344c458b5557e43f53d5c0af55466"} Jul 20 16:04:40.788024 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.787947 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:40.789261 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.789240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q76dr" event={"ID":"099e46af-8b56-4761-97f3-c42df0ce3bb6","Type":"ContainerStarted","Data":"050673a4268587a88f9b1f4c8395f51c395e83bbd2d671b4c2c63233b776ae3b"} Jul 20 16:04:40.790349 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.790331 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-d6qxd" event={"ID":"ac59cd04-a40a-4255-8483-fc4a042d2c51","Type":"ContainerStarted","Data":"b2d6c25248b1a9c47c98d0f3a419ec5b7a9f27e5b1dc4e32a75025c44486f6ed"} Jul 20 16:04:40.801065 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.801028 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6pjbj" podStartSLOduration=2.017192401 podStartE2EDuration="8.801015067s" totalImagesPullingTime="6.783822666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:40.799495778 +0000 UTC m=+58.863867024" watchObservedRunningTime="2026-07-20 16:04:40.801015067 +0000 UTC m=+58.865386312" Jul 20 16:04:40.815565 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:40.815526 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j2s45" podStartSLOduration=2.01247218 podStartE2EDuration="8.815512001s" totalImagesPullingTime="6.803039821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:40.81433815 +0000 UTC m=+58.878709397" watchObservedRunningTime="2026-07-20 16:04:40.815512001 +0000 UTC m=+58.879883225" Jul 20 16:04:42.713002 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:42.712627 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbgnt" Jul 20 16:04:44.807722 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:44.807679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q76dr" event={"ID":"099e46af-8b56-4761-97f3-c42df0ce3bb6","Type":"ContainerStarted","Data":"d978bf9a5eb083939b4abc63a24501517c89568828d3d74f7fa045e6864d8c48"} Jul 20 16:04:48.118815 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.118773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:48.121349 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.121321 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:04:48.131923 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.131901 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80ed257-9e45-4dd1-8aa6-50ce830b110a-original-pull-secret\") pod \"global-pull-secret-syncer-lg4gm\" (UID: \"b80ed257-9e45-4dd1-8aa6-50ce830b110a\") " pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:48.219768 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.219729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:48.221966 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.221941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:04:48.227394 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.227371 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4gm" Jul 20 16:04:48.232884 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.232861 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03a12d1b-e902-413a-85aa-079bb7f165be-metrics-certs\") pod \"network-metrics-daemon-bq6w5\" (UID: \"03a12d1b-e902-413a-85aa-079bb7f165be\") " pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:48.320337 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.320298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:48.322507 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.322483 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:04:48.330102 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.330069 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z4c96\"" Jul 20 16:04:48.332913 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.332890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:04:48.338490 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.338326 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bq6w5" Jul 20 16:04:48.344636 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.344613 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pzxx\" (UniqueName: \"kubernetes.io/projected/9c8dbf78-7129-40b1-b0e4-58c7ad76f843-kube-api-access-6pzxx\") pod \"network-check-target-5vtwc\" (UID: \"9c8dbf78-7129-40b1-b0e4-58c7ad76f843\") " pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:48.449836 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.449761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg4gm"] Jul 20 16:04:48.494297 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.494268 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bq6w5"] Jul 20 16:04:48.497430 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:04:48.497407 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a12d1b_e902_413a_85aa_079bb7f165be.slice/crio-c6ac8b3307c4d0e7009bb9bbd084f1acd4119c4c4ba4b90eb742a8ceba443696 WatchSource:0}: Error finding container c6ac8b3307c4d0e7009bb9bbd084f1acd4119c4c4ba4b90eb742a8ceba443696: Status 404 returned error can't find the container with id c6ac8b3307c4d0e7009bb9bbd084f1acd4119c4c4ba4b90eb742a8ceba443696 Jul 20 16:04:48.524780 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.524760 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzbbl\"" Jul 20 16:04:48.533406 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.533390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:04:48.672620 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.672588 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5vtwc"] Jul 20 16:04:48.675859 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:04:48.675831 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8dbf78_7129_40b1_b0e4_58c7ad76f843.slice/crio-cb4f9acb69da5520e88b5ea81f8608c9c08087c14e8ac15926d81e9ef5353b4b WatchSource:0}: Error finding container cb4f9acb69da5520e88b5ea81f8608c9c08087c14e8ac15926d81e9ef5353b4b: Status 404 returned error can't find the container with id cb4f9acb69da5520e88b5ea81f8608c9c08087c14e8ac15926d81e9ef5353b4b Jul 20 16:04:48.824498 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.824434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5vtwc" event={"ID":"9c8dbf78-7129-40b1-b0e4-58c7ad76f843","Type":"ContainerStarted","Data":"cb4f9acb69da5520e88b5ea81f8608c9c08087c14e8ac15926d81e9ef5353b4b"} Jul 20 16:04:48.827125 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.826966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q76dr" event={"ID":"099e46af-8b56-4761-97f3-c42df0ce3bb6","Type":"ContainerStarted","Data":"3505ff3492283b882931d5bbf1e8f958c14c7a98a8676bbf7ae652b627dd0d89"} Jul 20 16:04:48.828368 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.828342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bq6w5" event={"ID":"03a12d1b-e902-413a-85aa-079bb7f165be","Type":"ContainerStarted","Data":"c6ac8b3307c4d0e7009bb9bbd084f1acd4119c4c4ba4b90eb742a8ceba443696"} Jul 20 16:04:48.829570 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.829532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg4gm" event={"ID":"b80ed257-9e45-4dd1-8aa6-50ce830b110a","Type":"ContainerStarted","Data":"1e93e9e62f8f2cca4f5e0091c11d5b8d94adea7c976c8d9f6c2946ac3ddac265"} Jul 20 16:04:48.843995 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:48.843911 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q76dr" podStartSLOduration=2.079974047 podStartE2EDuration="16.843890423s" totalImagesPullingTime="14.763916376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:04:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:48.842444041 +0000 UTC m=+66.906815308" watchObservedRunningTime="2026-07-20 16:04:48.843890423 +0000 UTC m=+66.908261665" Jul 20 16:04:50.798345 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:50.797866 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j2s45" Jul 20 16:04:50.842440 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:50.842399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bq6w5" event={"ID":"03a12d1b-e902-413a-85aa-079bb7f165be","Type":"ContainerStarted","Data":"fb9f5edef9444c33f81bcfcaa72b101ff7860d0926faedcc848388dad88c13b1"} Jul 20 16:04:50.842613 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:50.842472 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bq6w5" event={"ID":"03a12d1b-e902-413a-85aa-079bb7f165be","Type":"ContainerStarted","Data":"fd9b20f7378ad9f9f44135bcabe62c3b59f75d59d9ab93977ca8f98dff6571b6"} Jul 20 16:04:50.858040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:50.857644 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bq6w5" podStartSLOduration=67.44627719 podStartE2EDuration="1m8.857622435s" totalImagesPullingTime="1.411345245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:50.857165039 +0000 UTC m=+68.921536308" watchObservedRunningTime="2026-07-20 16:04:50.857622435 +0000 UTC m=+68.921993682" Jul 20 16:04:52.182267 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.182230 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m68s9"] Jul 20 16:04:52.198882 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.198843 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m68s9"] Jul 20 16:04:52.199045 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.198990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.201402 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.201109 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 16:04:52.201402 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.201153 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 16:04:52.201402 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.201223 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 16:04:52.201402 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.201344 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 16:04:52.201646 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.201474 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-k7rj8\"" Jul 20 16:04:52.201886 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.201719 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 16:04:52.251294 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.251267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5s2\" (UniqueName: \"kubernetes.io/projected/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-kube-api-access-tq5s2\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.251407 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.251301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.251407 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.251347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.251407 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.251366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.351678 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.351646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5s2\" (UniqueName: \"kubernetes.io/projected/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-kube-api-access-tq5s2\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.351857 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.351693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.351857 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.351769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.351857 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.351795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.352028 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:52.351864 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 20 16:04:52.352028 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:04:52.351944 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-tls podName:dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988 nodeName:}" failed. No retries permitted until 2026-07-20 16:04:52.85192183 +0000 UTC m=+70.916293070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-m68s9" (UID: "dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988") : secret "prometheus-operator-tls" not found Jul 20 16:04:52.352461 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.352438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.354409 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.354390 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.359849 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.359810 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5s2\" (UniqueName: \"kubernetes.io/projected/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-kube-api-access-tq5s2\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.855992 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.855954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:52.858463 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:52.858436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m68s9\" (UID: \"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:53.110538 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:53.110447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" Jul 20 16:04:53.121144 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:53.121102 2561 patch_prober.go:28] interesting pod/image-registry-c757d75b8-z9s4r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 16:04:53.121286 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:53.121187 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" podUID="84ed4e7d-0efa-4422-b022-5668169bfabb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:04:54.774673 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:04:54.774643 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c757d75b8-z9s4r" Jul 20 16:05:01.427868 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.427835 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m68s9"] Jul 20 16:05:01.431049 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:01.431016 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb6a04c_1b4b_4a3f_b6ca_36d57a7c9988.slice/crio-be4212fca81bb5c0748502b95e48d485eb6025614f3fdfab562053cf97f67dac WatchSource:0}: Error finding container be4212fca81bb5c0748502b95e48d485eb6025614f3fdfab562053cf97f67dac: Status 404 returned error can't find the container with id be4212fca81bb5c0748502b95e48d485eb6025614f3fdfab562053cf97f67dac Jul 20 16:05:01.882920 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.882869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-d6qxd" event={"ID":"ac59cd04-a40a-4255-8483-fc4a042d2c51","Type":"ContainerStarted","Data":"b48d716c722fdd5253cc99e84731aa78d18622d6b793b471a646007297b9fb09"} Jul 20 16:05:01.883111 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.882942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:05:01.884994 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.884962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg4gm" event={"ID":"b80ed257-9e45-4dd1-8aa6-50ce830b110a","Type":"ContainerStarted","Data":"3ef76645baa2a8ccd47c89679a0e8bc17cb5d5a7007f11b463178c495c8b5dd7"} Jul 20 16:05:01.886284 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.886258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" event={"ID":"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988","Type":"ContainerStarted","Data":"be4212fca81bb5c0748502b95e48d485eb6025614f3fdfab562053cf97f67dac"} Jul 20 16:05:01.887846 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.887826 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5vtwc" event={"ID":"9c8dbf78-7129-40b1-b0e4-58c7ad76f843","Type":"ContainerStarted","Data":"7735984f9305f62c0c7c34b44697b2f041ab47375c6a62508c67106ff9953915"} Jul 20 16:05:01.888018 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.887994 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:05:01.898399 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.898374 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-d6qxd" Jul 20 16:05:01.898908 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.898851 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-d6qxd" podStartSLOduration=5.894744826 podStartE2EDuration="26.898837968s" totalImagesPullingTime="21.004093142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:01.897528584 +0000 UTC m=+79.961899829" watchObservedRunningTime="2026-07-20 16:05:01.898837968 +0000 UTC m=+79.963209215" Jul 20 16:05:01.911040 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.910958 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lg4gm" podStartSLOduration=67.068140434 podStartE2EDuration="1m19.910945085s" totalImagesPullingTime="12.842804651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:01.910315153 +0000 UTC m=+79.974686403" watchObservedRunningTime="2026-07-20 16:05:01.910945085 +0000 UTC m=+79.975316330" Jul 20 16:05:01.923998 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:01.923949 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5vtwc" podStartSLOduration=67.303686961 podStartE2EDuration="1m19.923934298s" totalImagesPullingTime="12.620247337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:01.923074404 +0000 UTC m=+79.987445676" watchObservedRunningTime="2026-07-20 16:05:01.923934298 +0000 UTC m=+79.988305543" Jul 20 16:05:03.901433 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:03.901389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" event={"ID":"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988","Type":"ContainerStarted","Data":"8929db3966e4ed6bbd35b3dfa88c90ee149e0c3c2fd0328e29af4bdf205d34ff"} Jul 20 16:05:03.901922 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:03.901497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" event={"ID":"dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988","Type":"ContainerStarted","Data":"64ab179dde2806446f331047c2346ed6479c92fcc31d20cec109fa981fa924f1"} Jul 20 16:05:03.916838 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:03.916778 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m68s9" podStartSLOduration=9.892270091 podStartE2EDuration="11.916760234s" totalImagesPullingTime="2.024490143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:03.916495877 +0000 UTC m=+81.980867126" watchObservedRunningTime="2026-07-20 16:05:03.916760234 +0000 UTC m=+81.981131483" Jul 20 16:05:05.581197 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.581160 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5wbvh"] Jul 20 16:05:05.639079 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.639045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.641935 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.641901 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 16:05:05.642232 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.642206 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 16:05:05.642343 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.642264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zz4tb\"" Jul 20 16:05:05.642343 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.642215 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 16:05:05.752041 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz25n\" (UniqueName: \"kubernetes.io/projected/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-kube-api-access-fz25n\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752209 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-sys\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752209 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-metrics-client-ca\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752209 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-root\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752209 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752397 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752397 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-textfile\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752397 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-tls\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.752397 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.752359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-wtmp\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853098 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-wtmp\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853098 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz25n\" (UniqueName: \"kubernetes.io/projected/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-kube-api-access-fz25n\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853098 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-sys\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-metrics-client-ca\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-root\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-sys\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-wtmp\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853261 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-root\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-textfile\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-tls\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853865 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853665 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-textfile\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853865 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853746 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-metrics-client-ca\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.853965 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.853877 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.855845 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.855822 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.855961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.855930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-node-exporter-tls\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.860410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.860388 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz25n\" (UniqueName: \"kubernetes.io/projected/4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e-kube-api-access-fz25n\") pod \"node-exporter-5wbvh\" (UID: \"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e\") " pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.949445 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:05.949411 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wbvh" Jul 20 16:05:05.990722 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:05.990686 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb9cf83_cf46_428f_b4f1_01cb10c4fc7e.slice/crio-af3fd6d6dffce1763073d6ad969b435a206be391c96ec3ff3e1b4faf68511fe2 WatchSource:0}: Error finding container af3fd6d6dffce1763073d6ad969b435a206be391c96ec3ff3e1b4faf68511fe2: Status 404 returned error can't find the container with id af3fd6d6dffce1763073d6ad969b435a206be391c96ec3ff3e1b4faf68511fe2 Jul 20 16:05:06.915551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:06.915507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wbvh" event={"ID":"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e","Type":"ContainerStarted","Data":"af3fd6d6dffce1763073d6ad969b435a206be391c96ec3ff3e1b4faf68511fe2"} Jul 20 16:05:07.528663 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.528628 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55d489f488-ls62g"] Jul 20 16:05:07.553595 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.553563 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55d489f488-ls62g"] Jul 20 16:05:07.553785 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.553711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.556947 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.557251 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.557323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.557465 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pthjc\"" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.557667 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.557703 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 16:05:07.560976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.557939 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7cuqn0sihp73c\"" Jul 20 16:05:07.667204 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667314 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667314 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-tls\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667314 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-grpc-tls\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667466 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7ckd\" (UniqueName: \"kubernetes.io/projected/ce6377bb-be27-4b61-bf97-04c096e5430d-kube-api-access-f7ckd\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667466 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667466 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce6377bb-be27-4b61-bf97-04c096e5430d-metrics-client-ca\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.667603 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.667474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.768661 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.768627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.768853 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.768685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.768853 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.768717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.768963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.768903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-tls\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.768963 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.768955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-grpc-tls\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.769059 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.768987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7ckd\" (UniqueName: \"kubernetes.io/projected/ce6377bb-be27-4b61-bf97-04c096e5430d-kube-api-access-f7ckd\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.769059 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.769029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.769206 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.769066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce6377bb-be27-4b61-bf97-04c096e5430d-metrics-client-ca\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.769948 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.769885 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce6377bb-be27-4b61-bf97-04c096e5430d-metrics-client-ca\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.771832 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.771791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.772623 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.772585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.772722 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.772706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.773118 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.773090 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-tls\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.774492 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.774464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.774931 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.774906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce6377bb-be27-4b61-bf97-04c096e5430d-secret-grpc-tls\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.776822 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.776776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7ckd\" (UniqueName: \"kubernetes.io/projected/ce6377bb-be27-4b61-bf97-04c096e5430d-kube-api-access-f7ckd\") pod \"thanos-querier-55d489f488-ls62g\" (UID: \"ce6377bb-be27-4b61-bf97-04c096e5430d\") " pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.870147 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.870100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:07.923069 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.923029 2561 generic.go:356] "Generic (PLEG): container finished" podID="4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e" containerID="c443952a0fb970fd878b4d0bbb70c3ca63b8a37a0244d105a3425fb95f7f6a45" exitCode=0 Jul 20 16:05:07.923501 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:07.923118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wbvh" event={"ID":"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e","Type":"ContainerDied","Data":"c443952a0fb970fd878b4d0bbb70c3ca63b8a37a0244d105a3425fb95f7f6a45"} Jul 20 16:05:08.051861 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:08.051833 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55d489f488-ls62g"] Jul 20 16:05:08.054990 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:08.054963 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6377bb_be27_4b61_bf97_04c096e5430d.slice/crio-8b79d64b769bc2b242f072a32fa94afde3bfb652039a60962c51a1633768d42a WatchSource:0}: Error finding container 8b79d64b769bc2b242f072a32fa94afde3bfb652039a60962c51a1633768d42a: Status 404 returned error can't find the container with id 8b79d64b769bc2b242f072a32fa94afde3bfb652039a60962c51a1633768d42a Jul 20 16:05:08.930079 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:08.930012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"8b79d64b769bc2b242f072a32fa94afde3bfb652039a60962c51a1633768d42a"} Jul 20 16:05:08.933703 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:08.933668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wbvh" event={"ID":"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e","Type":"ContainerStarted","Data":"cf35a31a8b1650eb65ac4a982c6b6da84a52cee8ceebd37159ff4d16f885b44c"} Jul 20 16:05:08.933854 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:08.933726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wbvh" event={"ID":"4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e","Type":"ContainerStarted","Data":"7debcfec6bd3242e578e6f9a0b85e6772ddd9f736ab447ebdef2fdf7bbe496bd"} Jul 20 16:05:08.954147 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:08.954083 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5wbvh" podStartSLOduration=2.245328493 podStartE2EDuration="3.954059881s" totalImagesPullingTime="1.619646668s" totalInitContainerRuntime="89.08472ms" isStatefulPod=true podCreationTimestamp="2026-07-20 16:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:08.953666495 +0000 UTC m=+87.018037734" watchObservedRunningTime="2026-07-20 16:05:08.954059881 +0000 UTC m=+87.018431128" Jul 20 16:05:10.325886 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.325651 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj"] Jul 20 16:05:10.359022 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.357874 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bf4465587-hjqsj"] Jul 20 16:05:10.359211 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.359095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:10.363419 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.362452 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 16:05:10.363419 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.362723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-clqhv\"" Jul 20 16:05:10.384060 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.384029 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj"] Jul 20 16:05:10.384206 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.384080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf4465587-hjqsj"] Jul 20 16:05:10.384206 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.384198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.386664 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.386202 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 16:05:10.386664 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.386552 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2p2cb\"" Jul 20 16:05:10.386903 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.386716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 16:05:10.386903 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.386789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 16:05:10.388655 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.387708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 16:05:10.388771 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.388708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 16:05:10.404506 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.404481 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 16:05:10.494494 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tc7d\" (UniqueName: \"kubernetes.io/projected/9c670e0c-0b31-4718-b864-756e5dd37a32-kube-api-access-6tc7d\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.494678 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-console-config\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.494678 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-service-ca\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.494678 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-serving-cert\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.494855 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zss4f\" (UniqueName: \"kubernetes.io/projected/fec8b8ab-1875-48ae-a657-1b11b704cd29-kube-api-access-zss4f\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:10.494855 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-oauth-config\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.494855 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-trusted-ca-bundle\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.495002 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fec8b8ab-1875-48ae-a657-1b11b704cd29-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:10.495002 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.494903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-oauth-serving-cert\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595317 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-serving-cert\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595317 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss4f\" (UniqueName: \"kubernetes.io/projected/fec8b8ab-1875-48ae-a657-1b11b704cd29-kube-api-access-zss4f\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:10.595530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-oauth-config\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-trusted-ca-bundle\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fec8b8ab-1875-48ae-a657-1b11b704cd29-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:10.595530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-oauth-serving-cert\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tc7d\" (UniqueName: \"kubernetes.io/projected/9c670e0c-0b31-4718-b864-756e5dd37a32-kube-api-access-6tc7d\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595530 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-console-config\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595814 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.595536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-service-ca\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.595814 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:05:10.595585 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 20 16:05:10.595814 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:05:10.595663 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fec8b8ab-1875-48ae-a657-1b11b704cd29-monitoring-plugin-cert podName:fec8b8ab-1875-48ae-a657-1b11b704cd29 nodeName:}" failed. No retries permitted until 2026-07-20 16:05:11.095639377 +0000 UTC m=+89.160010610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fec8b8ab-1875-48ae-a657-1b11b704cd29-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-m7zhj" (UID: "fec8b8ab-1875-48ae-a657-1b11b704cd29") : secret "monitoring-plugin-cert" not found Jul 20 16:05:10.596436 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.596211 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-service-ca\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.596436 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.596256 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-trusted-ca-bundle\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.596627 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.596512 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-oauth-serving-cert\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.596769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.596748 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-console-config\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.598192 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.598167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-oauth-config\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.598345 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.598321 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-serving-cert\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.604598 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.604573 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zss4f\" (UniqueName: \"kubernetes.io/projected/fec8b8ab-1875-48ae-a657-1b11b704cd29-kube-api-access-zss4f\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:10.607384 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.607362 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tc7d\" (UniqueName: \"kubernetes.io/projected/9c670e0c-0b31-4718-b864-756e5dd37a32-kube-api-access-6tc7d\") pod \"console-6bf4465587-hjqsj\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.702830 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.702805 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:10.810670 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.810630 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f55659d96-bcs8c"] Jul 20 16:05:10.828830 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.828785 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f55659d96-bcs8c"] Jul 20 16:05:10.829003 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.828929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.831308 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.831262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 20 16:05:10.831308 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.831277 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 20 16:05:10.831308 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.831280 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 20 16:05:10.831689 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.831667 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 20 16:05:10.831779 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.831722 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 20 16:05:10.831978 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.831959 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8q4d5\"" Jul 20 16:05:10.836671 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.836493 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 20 16:05:10.898024 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.897954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898024 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.897993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-federate-client-tls\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898024 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.898018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-metrics-client-ca\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898296 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.898063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-secret-telemeter-client\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898296 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.898098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-telemeter-client-tls\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898296 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.898168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-serving-certs-ca-bundle\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898296 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.898203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ns49\" (UniqueName: \"kubernetes.io/projected/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-kube-api-access-7ns49\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.898296 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.898262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:10.999974 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:10.999937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-telemeter-client-tls\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000065 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-serving-certs-ca-bundle\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000065 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ns49\" (UniqueName: \"kubernetes.io/projected/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-kube-api-access-7ns49\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000158 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000206 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000262 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-federate-client-tls\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000793 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-metrics-client-ca\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000899 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-secret-telemeter-client\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.000974 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.000953 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-serving-certs-ca-bundle\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.001279 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.001255 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.001632 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.001610 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-metrics-client-ca\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.003608 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.003585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.003904 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.003879 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-telemeter-client-tls\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.004347 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.004319 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-federate-client-tls\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.004444 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.004422 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-secret-telemeter-client\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.007455 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.007434 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ns49\" (UniqueName: \"kubernetes.io/projected/7aeed1b4-bf3e-4090-9987-f775a2cfcfbf-kube-api-access-7ns49\") pod \"telemeter-client-7f55659d96-bcs8c\" (UID: \"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf\") " pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.056632 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.056603 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf4465587-hjqsj"] Jul 20 16:05:11.061357 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:11.061335 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c670e0c_0b31_4718_b864_756e5dd37a32.slice/crio-c18d7959f1d690b66052b4b88407459665012aa4ee5d97cc093b33fc90404190 WatchSource:0}: Error finding container c18d7959f1d690b66052b4b88407459665012aa4ee5d97cc093b33fc90404190: Status 404 returned error can't find the container with id c18d7959f1d690b66052b4b88407459665012aa4ee5d97cc093b33fc90404190 Jul 20 16:05:11.102116 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.102089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fec8b8ab-1875-48ae-a657-1b11b704cd29-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:11.104582 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.104562 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fec8b8ab-1875-48ae-a657-1b11b704cd29-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m7zhj\" (UID: \"fec8b8ab-1875-48ae-a657-1b11b704cd29\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:11.141037 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.141011 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" Jul 20 16:05:11.273822 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.273794 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:11.277976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.277951 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f55659d96-bcs8c"] Jul 20 16:05:11.281116 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:11.281048 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aeed1b4_bf3e_4090_9987_f775a2cfcfbf.slice/crio-25b7fc2ba534748d91cd6e164b85e6b4ea3e2284520f163aa2862bb5f5949862 WatchSource:0}: Error finding container 25b7fc2ba534748d91cd6e164b85e6b4ea3e2284520f163aa2862bb5f5949862: Status 404 returned error can't find the container with id 25b7fc2ba534748d91cd6e164b85e6b4ea3e2284520f163aa2862bb5f5949862 Jul 20 16:05:11.417960 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.417886 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj"] Jul 20 16:05:11.420829 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:11.420804 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec8b8ab_1875_48ae_a657_1b11b704cd29.slice/crio-fd25fe4723dcf87f832f8624fd8a6d78469ea291fbfc5632bdf619c809613a91 WatchSource:0}: Error finding container fd25fe4723dcf87f832f8624fd8a6d78469ea291fbfc5632bdf619c809613a91: Status 404 returned error can't find the container with id fd25fe4723dcf87f832f8624fd8a6d78469ea291fbfc5632bdf619c809613a91 Jul 20 16:05:11.948456 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.948417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" event={"ID":"fec8b8ab-1875-48ae-a657-1b11b704cd29","Type":"ContainerStarted","Data":"fd25fe4723dcf87f832f8624fd8a6d78469ea291fbfc5632bdf619c809613a91"} Jul 20 16:05:11.954858 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.954692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"f68e2cd3adf39c3ad691d14d0c5a17240e7dcc3736b8fff1df8093277457c9bd"} Jul 20 16:05:11.954858 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.954770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"f02056ef69f716ca871397b3ac450acafa40eab1de7c5d1dbf8aad2f9343b7a9"} Jul 20 16:05:11.954858 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.954811 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"86e1c0541e4c565978b3600ef1b068131e348180d931db7ca20a8a804cba0daa"} Jul 20 16:05:11.956374 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.956269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf4465587-hjqsj" event={"ID":"9c670e0c-0b31-4718-b864-756e5dd37a32","Type":"ContainerStarted","Data":"c18d7959f1d690b66052b4b88407459665012aa4ee5d97cc093b33fc90404190"} Jul 20 16:05:11.958261 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:11.958232 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" event={"ID":"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf","Type":"ContainerStarted","Data":"25b7fc2ba534748d91cd6e164b85e6b4ea3e2284520f163aa2862bb5f5949862"} Jul 20 16:05:15.978421 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.978388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" event={"ID":"fec8b8ab-1875-48ae-a657-1b11b704cd29","Type":"ContainerStarted","Data":"27a7837200925431a24848ae12cf68ae7ed40d01dda61e5a6bea808e09a35b1a"} Jul 20 16:05:15.978873 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.978558 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:15.986154 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.986107 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" Jul 20 16:05:15.986398 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.986372 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"fbb9c960d590bc021b3e0519e5935c857bf09f109f85ff02e4879ea67300f3bf"} Jul 20 16:05:15.986484 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.986443 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:15.986533 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.986483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"809e98d23a36eae96cf28816640965df5a35f36c23b87506fc947c4b1986f18a"} Jul 20 16:05:15.986533 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.986523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" event={"ID":"ce6377bb-be27-4b61-bf97-04c096e5430d","Type":"ContainerStarted","Data":"e9e49e524354c1e99294e42c1a9b470584ae992a39ef5d0653ac94cce1993f6c"} Jul 20 16:05:15.987883 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.987859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf4465587-hjqsj" event={"ID":"9c670e0c-0b31-4718-b864-756e5dd37a32","Type":"ContainerStarted","Data":"ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424"} Jul 20 16:05:15.989319 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.989290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" event={"ID":"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf","Type":"ContainerStarted","Data":"b27579c30aa461f3defd04d10f879a0ac08d16afbe567c77d1d921e5609d7ad9"} Jul 20 16:05:15.997323 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:15.997222 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m7zhj" podStartSLOduration=1.89115571 podStartE2EDuration="5.997206332s" totalImagesPullingTime="4.106050622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:15.996475248 +0000 UTC m=+94.060846494" watchObservedRunningTime="2026-07-20 16:05:15.997206332 +0000 UTC m=+94.061577584" Jul 20 16:05:16.016510 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:16.016475 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" podStartSLOduration=1.8978634620000001 podStartE2EDuration="9.016462848s" totalImagesPullingTime="7.118599386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:05:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:16.015145424 +0000 UTC m=+94.079516687" watchObservedRunningTime="2026-07-20 16:05:16.016462848 +0000 UTC m=+94.080834093" Jul 20 16:05:16.045402 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:16.045355 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bf4465587-hjqsj" podStartSLOduration=1.573931152 podStartE2EDuration="6.045339711s" totalImagesPullingTime="4.471408559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:16.044264331 +0000 UTC m=+94.108635581" watchObservedRunningTime="2026-07-20 16:05:16.045339711 +0000 UTC m=+94.109710957" Jul 20 16:05:17.000144 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:17.000105 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55d489f488-ls62g" Jul 20 16:05:17.999183 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:17.999145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" event={"ID":"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf","Type":"ContainerStarted","Data":"fa8a3f3348c90664003d787767324b5f09d1c22762c6fa838450b356820fc763"} Jul 20 16:05:17.999425 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:17.999207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" event={"ID":"7aeed1b4-bf3e-4090-9987-f775a2cfcfbf","Type":"ContainerStarted","Data":"142b7f3a5bd1639213507ed818bb4f4d5cd34ba998de1d6b082ff3f50945d98d"} Jul 20 16:05:18.030382 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.030326 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f55659d96-bcs8c" podStartSLOduration=2.386318757 podStartE2EDuration="8.030311763s" totalImagesPullingTime="5.643993006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:05:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:18.028772307 +0000 UTC m=+96.093143554" watchObservedRunningTime="2026-07-20 16:05:18.030311763 +0000 UTC m=+96.094683008" Jul 20 16:05:18.716252 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.716219 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf4465587-hjqsj"] Jul 20 16:05:18.754897 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.754867 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8977fb48c-rw22q"] Jul 20 16:05:18.774504 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.774475 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8977fb48c-rw22q"] Jul 20 16:05:18.774661 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.774595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.869463 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.869424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-serving-cert\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.869759 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.869736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwkhq\" (UniqueName: \"kubernetes.io/projected/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-kube-api-access-hwkhq\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.869931 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.869914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-oauth-serving-cert\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.870079 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.870062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-service-ca\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.870235 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.870218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-oauth-config\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.870362 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.870348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-config\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.870480 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.870466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-trusted-ca-bundle\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971559 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-oauth-serving-cert\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971559 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-service-ca\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-oauth-config\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-config\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-trusted-ca-bundle\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-serving-cert\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.971769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.971697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwkhq\" (UniqueName: \"kubernetes.io/projected/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-kube-api-access-hwkhq\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.972410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.972384 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-oauth-serving-cert\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.972555 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.972386 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-service-ca\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.972555 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.972471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-config\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.972655 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.972580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-trusted-ca-bundle\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.974060 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.974038 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-oauth-config\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.974356 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.974333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-serving-cert\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:18.978669 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:18.978644 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwkhq\" (UniqueName: \"kubernetes.io/projected/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-kube-api-access-hwkhq\") pod \"console-8977fb48c-rw22q\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:19.083012 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:19.082964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:19.245966 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:19.245881 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8977fb48c-rw22q"] Jul 20 16:05:19.250164 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:05:19.250117 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cd18ff_26e7_4d67_aa3c_ad5688c4ae58.slice/crio-fe693fe153831764d6607ac41dfa57087e9af03372d26ebc3f63f455d6c58248 WatchSource:0}: Error finding container fe693fe153831764d6607ac41dfa57087e9af03372d26ebc3f63f455d6c58248: Status 404 returned error can't find the container with id fe693fe153831764d6607ac41dfa57087e9af03372d26ebc3f63f455d6c58248 Jul 20 16:05:20.008294 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:20.008255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8977fb48c-rw22q" event={"ID":"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58","Type":"ContainerStarted","Data":"fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f"} Jul 20 16:05:20.008465 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:20.008302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8977fb48c-rw22q" event={"ID":"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58","Type":"ContainerStarted","Data":"fe693fe153831764d6607ac41dfa57087e9af03372d26ebc3f63f455d6c58248"} Jul 20 16:05:20.024616 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:20.024572 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8977fb48c-rw22q" podStartSLOduration=2.024557233 podStartE2EDuration="2.024557233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:05:20.023023653 +0000 UTC m=+98.087394899" watchObservedRunningTime="2026-07-20 16:05:20.024557233 +0000 UTC m=+98.088928478" Jul 20 16:05:20.703227 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:20.703195 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:29.083320 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:29.083284 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:29.083851 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:29.083392 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:29.088209 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:29.088190 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:30.046334 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:30.046305 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:05:32.899549 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:32.899517 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5vtwc" Jul 20 16:05:43.739435 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:43.739370 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bf4465587-hjqsj" podUID="9c670e0c-0b31-4718-b864-756e5dd37a32" containerName="console" containerID="cri-o://ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424" gracePeriod=15 Jul 20 16:05:44.051221 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.047306 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:44.063370 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063310 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-serving-cert\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.063370 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063368 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-trusted-ca-bundle\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.063784 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063410 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-oauth-config\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.063784 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063447 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-console-config\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.063784 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063477 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-oauth-serving-cert\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.063784 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063504 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tc7d\" (UniqueName: \"kubernetes.io/projected/9c670e0c-0b31-4718-b864-756e5dd37a32-kube-api-access-6tc7d\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.063784 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063554 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-service-ca\") pod \"9c670e0c-0b31-4718-b864-756e5dd37a32\" (UID: \"9c670e0c-0b31-4718-b864-756e5dd37a32\") " Jul 20 16:05:44.064070 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063799 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-console-config" (OuterVolumeSpecName: "console-config") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:05:44.064070 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063812 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:05:44.064070 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.063870 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:05:44.064070 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.064034 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:05:44.066295 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.066267 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:05:44.066387 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.066344 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c670e0c-0b31-4718-b864-756e5dd37a32-kube-api-access-6tc7d" (OuterVolumeSpecName: "kube-api-access-6tc7d") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "kube-api-access-6tc7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:05:44.066685 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.066645 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c670e0c-0b31-4718-b864-756e5dd37a32" (UID: "9c670e0c-0b31-4718-b864-756e5dd37a32"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:05:44.099840 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.098222 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c670e0c-0b31-4718-b864-756e5dd37a32" containerID="ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424" exitCode=0 Jul 20 16:05:44.099840 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.098362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf4465587-hjqsj" event={"ID":"9c670e0c-0b31-4718-b864-756e5dd37a32","Type":"ContainerDied","Data":"ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424"} Jul 20 16:05:44.099840 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.098423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf4465587-hjqsj" event={"ID":"9c670e0c-0b31-4718-b864-756e5dd37a32","Type":"ContainerDied","Data":"c18d7959f1d690b66052b4b88407459665012aa4ee5d97cc093b33fc90404190"} Jul 20 16:05:44.099840 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.098456 2561 scope.go:117] "RemoveContainer" containerID="ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424" Jul 20 16:05:44.099840 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.098648 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf4465587-hjqsj" Jul 20 16:05:44.118484 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.118455 2561 scope.go:117] "RemoveContainer" containerID="ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424" Jul 20 16:05:44.118830 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:05:44.118798 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424\": container with ID starting with ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424 not found: ID does not exist" containerID="ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424" Jul 20 16:05:44.118944 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.118834 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424"} err="failed to get container status \"ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424\": rpc error: code = NotFound desc = could not find container \"ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424\": container with ID starting with ccb03902f291e63d3610f3a35c2e81902eaf131418d9b037c6d3e3d8dd1cb424 not found: ID does not exist" Jul 20 16:05:44.123353 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.123327 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf4465587-hjqsj"] Jul 20 16:05:44.126734 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.126711 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bf4465587-hjqsj"] Jul 20 16:05:44.164153 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164107 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.164153 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164149 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.164153 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164160 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c670e0c-0b31-4718-b864-756e5dd37a32-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.164410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164170 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.164410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164179 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.164410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164187 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tc7d\" (UniqueName: \"kubernetes.io/projected/9c670e0c-0b31-4718-b864-756e5dd37a32-kube-api-access-6tc7d\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.164410 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.164196 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c670e0c-0b31-4718-b864-756e5dd37a32-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:05:44.517420 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:05:44.517391 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c670e0c-0b31-4718-b864-756e5dd37a32" path="/var/lib/kubelet/pods/9c670e0c-0b31-4718-b864-756e5dd37a32/volumes" Jul 20 16:06:28.076583 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.076547 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-974f8fb75-mxdn8"] Jul 20 16:06:28.077013 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.076806 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c670e0c-0b31-4718-b864-756e5dd37a32" containerName="console" Jul 20 16:06:28.077013 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.076817 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c670e0c-0b31-4718-b864-756e5dd37a32" containerName="console" Jul 20 16:06:28.077013 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.076879 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c670e0c-0b31-4718-b864-756e5dd37a32" containerName="console" Jul 20 16:06:28.079881 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.079865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.088712 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.088689 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-974f8fb75-mxdn8"] Jul 20 16:06:28.198123 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-oauth-serving-cert\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.198123 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-trusted-ca-bundle\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.198293 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-service-ca\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.198293 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-console-config\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.198293 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-oauth-config\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.198293 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8jb\" (UniqueName: \"kubernetes.io/projected/ded1cdf5-716b-4d95-a58f-44a15264e126-kube-api-access-xz8jb\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.198458 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.198318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-serving-cert\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.298944 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.298918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-oauth-serving-cert\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.298944 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.298947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-trusted-ca-bundle\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299124 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.298979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-service-ca\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299124 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-console-config\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299124 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-oauth-config\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299124 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8jb\" (UniqueName: \"kubernetes.io/projected/ded1cdf5-716b-4d95-a58f-44a15264e126-kube-api-access-xz8jb\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299294 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-serving-cert\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299811 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-oauth-serving-cert\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299922 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-service-ca\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299922 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299861 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-trusted-ca-bundle\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.299999 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.299924 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-console-config\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.301596 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.301571 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-oauth-config\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.301678 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.301615 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-serving-cert\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.306182 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.306166 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8jb\" (UniqueName: \"kubernetes.io/projected/ded1cdf5-716b-4d95-a58f-44a15264e126-kube-api-access-xz8jb\") pod \"console-974f8fb75-mxdn8\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.389940 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.389856 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:28.508330 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:28.508301 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-974f8fb75-mxdn8"] Jul 20 16:06:28.511460 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:06:28.511437 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded1cdf5_716b_4d95_a58f_44a15264e126.slice/crio-d21f02d68e5e666a8106a1f5e06284a14303076676adf58799d2eabd1d8f8bbb WatchSource:0}: Error finding container d21f02d68e5e666a8106a1f5e06284a14303076676adf58799d2eabd1d8f8bbb: Status 404 returned error can't find the container with id d21f02d68e5e666a8106a1f5e06284a14303076676adf58799d2eabd1d8f8bbb Jul 20 16:06:29.274085 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:29.274043 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-974f8fb75-mxdn8" event={"ID":"ded1cdf5-716b-4d95-a58f-44a15264e126","Type":"ContainerStarted","Data":"8344e02e9eed43952e14e95caa438f335fdd1d192c0f48600534b90caa987d95"} Jul 20 16:06:29.274478 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:29.274101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-974f8fb75-mxdn8" event={"ID":"ded1cdf5-716b-4d95-a58f-44a15264e126","Type":"ContainerStarted","Data":"d21f02d68e5e666a8106a1f5e06284a14303076676adf58799d2eabd1d8f8bbb"} Jul 20 16:06:29.289144 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:29.289093 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-974f8fb75-mxdn8" podStartSLOduration=1.289078797 podStartE2EDuration="1.289078797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:06:29.287915924 +0000 UTC m=+167.352287182" watchObservedRunningTime="2026-07-20 16:06:29.289078797 +0000 UTC m=+167.353450042" Jul 20 16:06:38.390517 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:38.390434 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:38.390517 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:38.390517 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:38.397551 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:38.397524 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:39.314153 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:39.314116 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:06:39.359066 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:06:39.359036 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8977fb48c-rw22q"] Jul 20 16:07:04.385471 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.385431 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8977fb48c-rw22q" podUID="06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" containerName="console" containerID="cri-o://fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f" gracePeriod=15 Jul 20 16:07:04.624200 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.624177 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:07:04.676811 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676741 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-config\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.676811 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676786 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwkhq\" (UniqueName: \"kubernetes.io/projected/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-kube-api-access-hwkhq\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.676981 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676813 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-oauth-config\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.676981 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676842 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-trusted-ca-bundle\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.676981 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676867 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-serving-cert\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.676981 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676888 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-service-ca\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.676981 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.676919 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-oauth-serving-cert\") pod \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\" (UID: \"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58\") " Jul 20 16:07:04.677356 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.677177 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-config" (OuterVolumeSpecName: "console-config") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:07:04.677356 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.677311 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-service-ca" (OuterVolumeSpecName: "service-ca") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:07:04.677356 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.677322 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:07:04.677485 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.677391 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:07:04.678945 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.678920 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:07:04.679030 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.678942 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-kube-api-access-hwkhq" (OuterVolumeSpecName: "kube-api-access-hwkhq") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "kube-api-access-hwkhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:07:04.679030 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.678970 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" (UID: "06cd18ff-26e7-4d67-aa3c-ad5688c4ae58"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:07:04.777401 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777378 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:04.777401 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777403 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:04.777526 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777413 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:04.777526 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777421 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:04.777526 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777429 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwkhq\" (UniqueName: \"kubernetes.io/projected/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-kube-api-access-hwkhq\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:04.777526 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777437 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:04.777526 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:04.777447 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:05.404667 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.404636 2561 generic.go:356] "Generic (PLEG): container finished" podID="06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" containerID="fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f" exitCode=0 Jul 20 16:07:05.405090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.404676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8977fb48c-rw22q" event={"ID":"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58","Type":"ContainerDied","Data":"fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f"} Jul 20 16:07:05.405090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.404687 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8977fb48c-rw22q" Jul 20 16:07:05.405090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.404712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8977fb48c-rw22q" event={"ID":"06cd18ff-26e7-4d67-aa3c-ad5688c4ae58","Type":"ContainerDied","Data":"fe693fe153831764d6607ac41dfa57087e9af03372d26ebc3f63f455d6c58248"} Jul 20 16:07:05.405090 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.404731 2561 scope.go:117] "RemoveContainer" containerID="fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f" Jul 20 16:07:05.413402 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.413382 2561 scope.go:117] "RemoveContainer" containerID="fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f" Jul 20 16:07:05.413739 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:07:05.413719 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f\": container with ID starting with fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f not found: ID does not exist" containerID="fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f" Jul 20 16:07:05.413805 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.413747 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f"} err="failed to get container status \"fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f\": rpc error: code = NotFound desc = could not find container \"fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f\": container with ID starting with fa5e188687ded3ffbb9c2ccf580129125472e043ca8c7d9e1ab738e33c871d6f not found: ID does not exist" Jul 20 16:07:05.424304 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.424282 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8977fb48c-rw22q"] Jul 20 16:07:05.428650 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:05.428630 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8977fb48c-rw22q"] Jul 20 16:07:06.518182 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:06.518147 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" path="/var/lib/kubelet/pods/06cd18ff-26e7-4d67-aa3c-ad5688c4ae58/volumes" Jul 20 16:07:19.502257 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.502217 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm"] Jul 20 16:07:19.502706 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.502501 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" containerName="console" Jul 20 16:07:19.502706 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.502515 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" containerName="console" Jul 20 16:07:19.502706 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.502567 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="06cd18ff-26e7-4d67-aa3c-ad5688c4ae58" containerName="console" Jul 20 16:07:19.505485 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.505467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.507522 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.507491 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 16:07:19.507634 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.507517 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 16:07:19.507634 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.507596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qt4q5\"" Jul 20 16:07:19.513824 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.513800 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm"] Jul 20 16:07:19.587961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.587918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.587961 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.587967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.588189 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.588062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x275\" (UniqueName: \"kubernetes.io/projected/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-kube-api-access-2x275\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.688699 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.688674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.688820 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.688702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.688820 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.688732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x275\" (UniqueName: \"kubernetes.io/projected/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-kube-api-access-2x275\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.689076 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.689055 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.689150 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.689116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.697009 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.696986 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x275\" (UniqueName: \"kubernetes.io/projected/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-kube-api-access-2x275\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.815179 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.815107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:19.937787 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:19.937758 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm"] Jul 20 16:07:19.940927 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:07:19.940898 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168e60e2_31ce_47f6_9b26_cb4bdd9ab0e4.slice/crio-d1ec35e67a570fa8912ca394fed7a5eb489f5005230b5fe3ba856230d199e335 WatchSource:0}: Error finding container d1ec35e67a570fa8912ca394fed7a5eb489f5005230b5fe3ba856230d199e335: Status 404 returned error can't find the container with id d1ec35e67a570fa8912ca394fed7a5eb489f5005230b5fe3ba856230d199e335 Jul 20 16:07:20.459858 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:20.459824 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" event={"ID":"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4","Type":"ContainerStarted","Data":"d1ec35e67a570fa8912ca394fed7a5eb489f5005230b5fe3ba856230d199e335"} Jul 20 16:07:28.492219 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:28.492179 2561 generic.go:356] "Generic (PLEG): container finished" podID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerID="7a71c23a62342d8aaaf3414a776b7f3d6d158fd308a7d500be7816bbd5930f57" exitCode=0 Jul 20 16:07:28.492730 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:28.492259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" event={"ID":"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4","Type":"ContainerDied","Data":"7a71c23a62342d8aaaf3414a776b7f3d6d158fd308a7d500be7816bbd5930f57"} Jul 20 16:07:30.501667 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:30.501632 2561 generic.go:356] "Generic (PLEG): container finished" podID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerID="1552c01ead04251cee2e15bdc025bb6dd00b47d1ffb448f3f3e6343503c323c3" exitCode=0 Jul 20 16:07:30.502068 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:30.501702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" event={"ID":"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4","Type":"ContainerDied","Data":"1552c01ead04251cee2e15bdc025bb6dd00b47d1ffb448f3f3e6343503c323c3"} Jul 20 16:07:38.534601 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:38.534566 2561 generic.go:356] "Generic (PLEG): container finished" podID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerID="d418b0cafbef732dfc5b53c83e164a64141621c53fad97df9376eb9a9035539c" exitCode=0 Jul 20 16:07:38.535017 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:38.534647 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" event={"ID":"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4","Type":"ContainerDied","Data":"d418b0cafbef732dfc5b53c83e164a64141621c53fad97df9376eb9a9035539c"} Jul 20 16:07:39.657317 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.657291 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:39.761909 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.761886 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-util\") pod \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " Jul 20 16:07:39.762049 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.761939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x275\" (UniqueName: \"kubernetes.io/projected/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-kube-api-access-2x275\") pod \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " Jul 20 16:07:39.762049 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.761994 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-bundle\") pod \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\" (UID: \"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4\") " Jul 20 16:07:39.762659 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.762632 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-bundle" (OuterVolumeSpecName: "bundle") pod "168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" (UID: "168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:07:39.763966 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.763935 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-kube-api-access-2x275" (OuterVolumeSpecName: "kube-api-access-2x275") pod "168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" (UID: "168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4"). InnerVolumeSpecName "kube-api-access-2x275". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:07:39.766127 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.766105 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-util" (OuterVolumeSpecName: "util") pod "168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" (UID: "168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:07:39.862812 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.862722 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:39.862812 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.862761 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-util\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:39.862812 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:39.862770 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x275\" (UniqueName: \"kubernetes.io/projected/168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4-kube-api-access-2x275\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:07:40.543418 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:40.543388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" event={"ID":"168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4","Type":"ContainerDied","Data":"d1ec35e67a570fa8912ca394fed7a5eb489f5005230b5fe3ba856230d199e335"} Jul 20 16:07:40.543418 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:40.543411 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sgwmm" Jul 20 16:07:40.543582 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:40.543431 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1ec35e67a570fa8912ca394fed7a5eb489f5005230b5fe3ba856230d199e335" Jul 20 16:07:47.483662 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483626 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr"] Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483899 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="util" Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483909 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="util" Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483924 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="pull" Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483930 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="pull" Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483938 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="extract" Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483944 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="extract" Jul 20 16:07:47.484176 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.483981 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="168e60e2-31ce-47f6-9b26-cb4bdd9ab0e4" containerName="extract" Jul 20 16:07:47.487647 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.487631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.489786 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.489764 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:07:47.489910 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.489764 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-sdmb9\"" Jul 20 16:07:47.489910 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.489796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 20 16:07:47.496848 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.496828 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr"] Jul 20 16:07:47.517370 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.517344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcvtk\" (UniqueName: \"kubernetes.io/projected/507865d7-9490-4d11-8412-b5ab9dd1f0ad-kube-api-access-pcvtk\") pod \"cert-manager-operator-controller-manager-56b4598547-5j9nr\" (UID: \"507865d7-9490-4d11-8412-b5ab9dd1f0ad\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.517468 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.517382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507865d7-9490-4d11-8412-b5ab9dd1f0ad-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-5j9nr\" (UID: \"507865d7-9490-4d11-8412-b5ab9dd1f0ad\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.617940 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.617912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcvtk\" (UniqueName: \"kubernetes.io/projected/507865d7-9490-4d11-8412-b5ab9dd1f0ad-kube-api-access-pcvtk\") pod \"cert-manager-operator-controller-manager-56b4598547-5j9nr\" (UID: \"507865d7-9490-4d11-8412-b5ab9dd1f0ad\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.618060 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.617956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507865d7-9490-4d11-8412-b5ab9dd1f0ad-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-5j9nr\" (UID: \"507865d7-9490-4d11-8412-b5ab9dd1f0ad\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.618340 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.618324 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507865d7-9490-4d11-8412-b5ab9dd1f0ad-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-5j9nr\" (UID: \"507865d7-9490-4d11-8412-b5ab9dd1f0ad\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.625612 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.625582 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcvtk\" (UniqueName: \"kubernetes.io/projected/507865d7-9490-4d11-8412-b5ab9dd1f0ad-kube-api-access-pcvtk\") pod \"cert-manager-operator-controller-manager-56b4598547-5j9nr\" (UID: \"507865d7-9490-4d11-8412-b5ab9dd1f0ad\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.796663 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.796635 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" Jul 20 16:07:47.922631 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:47.922576 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr"] Jul 20 16:07:47.925576 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:07:47.925553 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507865d7_9490_4d11_8412_b5ab9dd1f0ad.slice/crio-be394eb5da14c2d40984929aaf8751660f2e1f34744d275895a3f2d0fdf6b241 WatchSource:0}: Error finding container be394eb5da14c2d40984929aaf8751660f2e1f34744d275895a3f2d0fdf6b241: Status 404 returned error can't find the container with id be394eb5da14c2d40984929aaf8751660f2e1f34744d275895a3f2d0fdf6b241 Jul 20 16:07:48.571966 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:48.571801 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" event={"ID":"507865d7-9490-4d11-8412-b5ab9dd1f0ad","Type":"ContainerStarted","Data":"be394eb5da14c2d40984929aaf8751660f2e1f34744d275895a3f2d0fdf6b241"} Jul 20 16:07:49.577827 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:49.577786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" event={"ID":"507865d7-9490-4d11-8412-b5ab9dd1f0ad","Type":"ContainerStarted","Data":"5e625d09afe1a64ca5e49c67f9fc9c0fec247fde779b4d1f09b9b60bde64a36b"} Jul 20 16:07:49.601690 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:49.601581 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5j9nr" podStartSLOduration=1.197766812 podStartE2EDuration="2.601561852s" totalImagesPullingTime="1.40379504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:07:49.600464306 +0000 UTC m=+247.664835562" watchObservedRunningTime="2026-07-20 16:07:49.601561852 +0000 UTC m=+247.665933098" Jul 20 16:07:53.709579 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.709551 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgj2m"] Jul 20 16:07:53.711747 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.711733 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:53.713821 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.713794 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 16:07:53.714257 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.714241 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6kwg5\"" Jul 20 16:07:53.714312 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.714264 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 16:07:53.723069 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.723044 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgj2m"] Jul 20 16:07:53.761141 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.761114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgj2m\" (UID: \"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:53.761227 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.761173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2kgc\" (UniqueName: \"kubernetes.io/projected/2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80-kube-api-access-f2kgc\") pod \"cert-manager-webhook-6486ffd997-vgj2m\" (UID: \"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:53.861681 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.861655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgj2m\" (UID: \"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:53.861774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.861707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2kgc\" (UniqueName: \"kubernetes.io/projected/2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80-kube-api-access-f2kgc\") pod \"cert-manager-webhook-6486ffd997-vgj2m\" (UID: \"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:53.871758 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.871727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgj2m\" (UID: \"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:53.871876 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:53.871852 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2kgc\" (UniqueName: \"kubernetes.io/projected/2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80-kube-api-access-f2kgc\") pod \"cert-manager-webhook-6486ffd997-vgj2m\" (UID: \"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:54.040360 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:54.040328 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:54.167675 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:54.167650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgj2m"] Jul 20 16:07:54.169901 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:07:54.169862 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bdb8ecb_2d2c_4e8e_9403_00d7fbfdea80.slice/crio-344aad8f32dbec5b38663dc8025987e4dc185d1a04c2288b5bb2bf0fcf74c1f5 WatchSource:0}: Error finding container 344aad8f32dbec5b38663dc8025987e4dc185d1a04c2288b5bb2bf0fcf74c1f5: Status 404 returned error can't find the container with id 344aad8f32dbec5b38663dc8025987e4dc185d1a04c2288b5bb2bf0fcf74c1f5 Jul 20 16:07:54.598640 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:54.598610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" event={"ID":"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80","Type":"ContainerStarted","Data":"344aad8f32dbec5b38663dc8025987e4dc185d1a04c2288b5bb2bf0fcf74c1f5"} Jul 20 16:07:57.615099 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:57.613676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" event={"ID":"2bdb8ecb-2d2c-4e8e-9403-00d7fbfdea80","Type":"ContainerStarted","Data":"3e9861cb176ac65039d25f084b8a90e9325f0b4dedc8de07a9e10f2f64b90629"} Jul 20 16:07:57.615099 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:57.614384 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:07:57.630396 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:07:57.630351 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" podStartSLOduration=2.147410842 podStartE2EDuration="4.630334686s" totalImagesPullingTime="2.482923844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:07:57.628489363 +0000 UTC m=+255.692860610" watchObservedRunningTime="2026-07-20 16:07:57.630334686 +0000 UTC m=+255.694705932" Jul 20 16:08:01.586322 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.586289 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qjzs"] Jul 20 16:08:01.588666 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.588651 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.590620 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.590600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8fwdc\"" Jul 20 16:08:01.597675 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.597654 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qjzs"] Jul 20 16:08:01.614677 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.614653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzrc\" (UniqueName: \"kubernetes.io/projected/9cffceb3-d5a8-469f-b869-bc5acd0bfbac-kube-api-access-tqzrc\") pod \"cert-manager-55b4d954d5-9qjzs\" (UID: \"9cffceb3-d5a8-469f-b869-bc5acd0bfbac\") " pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.614777 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.614693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cffceb3-d5a8-469f-b869-bc5acd0bfbac-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qjzs\" (UID: \"9cffceb3-d5a8-469f-b869-bc5acd0bfbac\") " pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.715935 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.715906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cffceb3-d5a8-469f-b869-bc5acd0bfbac-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qjzs\" (UID: \"9cffceb3-d5a8-469f-b869-bc5acd0bfbac\") " pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.716067 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.715965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzrc\" (UniqueName: \"kubernetes.io/projected/9cffceb3-d5a8-469f-b869-bc5acd0bfbac-kube-api-access-tqzrc\") pod \"cert-manager-55b4d954d5-9qjzs\" (UID: \"9cffceb3-d5a8-469f-b869-bc5acd0bfbac\") " pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.724233 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.724205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cffceb3-d5a8-469f-b869-bc5acd0bfbac-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qjzs\" (UID: \"9cffceb3-d5a8-469f-b869-bc5acd0bfbac\") " pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.724356 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.724302 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzrc\" (UniqueName: \"kubernetes.io/projected/9cffceb3-d5a8-469f-b869-bc5acd0bfbac-kube-api-access-tqzrc\") pod \"cert-manager-55b4d954d5-9qjzs\" (UID: \"9cffceb3-d5a8-469f-b869-bc5acd0bfbac\") " pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:01.897445 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:01.897378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9qjzs" Jul 20 16:08:02.020808 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:02.020776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qjzs"] Jul 20 16:08:02.024842 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:08:02.024811 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cffceb3_d5a8_469f_b869_bc5acd0bfbac.slice/crio-a09d15b1cd0a955ebc5a8d1864f49e4b5d39693271acde0e440fb6fb43ee664c WatchSource:0}: Error finding container a09d15b1cd0a955ebc5a8d1864f49e4b5d39693271acde0e440fb6fb43ee664c: Status 404 returned error can't find the container with id a09d15b1cd0a955ebc5a8d1864f49e4b5d39693271acde0e440fb6fb43ee664c Jul 20 16:08:02.634806 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:02.634765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9qjzs" event={"ID":"9cffceb3-d5a8-469f-b869-bc5acd0bfbac","Type":"ContainerStarted","Data":"f3cfcb6158f17c56b7f5dc037ceeea8eea40c7901f5249d47e10a4c38a2bf35f"} Jul 20 16:08:02.635210 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:02.634816 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9qjzs" event={"ID":"9cffceb3-d5a8-469f-b869-bc5acd0bfbac","Type":"ContainerStarted","Data":"a09d15b1cd0a955ebc5a8d1864f49e4b5d39693271acde0e440fb6fb43ee664c"} Jul 20 16:08:02.649111 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:02.649054 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9qjzs" podStartSLOduration=1.649037582 podStartE2EDuration="1.649037582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:08:02.648565853 +0000 UTC m=+260.712937100" watchObservedRunningTime="2026-07-20 16:08:02.649037582 +0000 UTC m=+260.713408828" Jul 20 16:08:03.912255 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.912220 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl"] Jul 20 16:08:03.915407 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.915375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:03.918092 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.918063 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qt4q5\"" Jul 20 16:08:03.918399 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.918372 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 16:08:03.918698 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.918679 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 16:08:03.922774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.922730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl"] Jul 20 16:08:03.933015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.932996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:03.933112 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.933033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:03.933112 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:03.933073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86tp\" (UniqueName: \"kubernetes.io/projected/95fe306c-2145-4279-83c4-850ad0c4c892-kube-api-access-r86tp\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.034451 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.034417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.034564 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.034461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.034601 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.034576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r86tp\" (UniqueName: \"kubernetes.io/projected/95fe306c-2145-4279-83c4-850ad0c4c892-kube-api-access-r86tp\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.034802 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.034788 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.034850 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.034818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.041774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.041719 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r86tp\" (UniqueName: \"kubernetes.io/projected/95fe306c-2145-4279-83c4-850ad0c4c892-kube-api-access-r86tp\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.227535 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.227464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:04.352833 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.352811 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl"] Jul 20 16:08:04.354803 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:08:04.354775 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fe306c_2145_4279_83c4_850ad0c4c892.slice/crio-b39a2063e0f6491cd7d69bedacaaf8fd0842379220f5f11533ee5e4cb6405285 WatchSource:0}: Error finding container b39a2063e0f6491cd7d69bedacaaf8fd0842379220f5f11533ee5e4cb6405285: Status 404 returned error can't find the container with id b39a2063e0f6491cd7d69bedacaaf8fd0842379220f5f11533ee5e4cb6405285 Jul 20 16:08:04.624303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.624281 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vgj2m" Jul 20 16:08:04.644058 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.644030 2561 generic.go:356] "Generic (PLEG): container finished" podID="95fe306c-2145-4279-83c4-850ad0c4c892" containerID="635c14247e14bab56bdf29beaa7c562fd507b5a97abd6c6a841aac05cc004bfa" exitCode=0 Jul 20 16:08:04.644178 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.644113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" event={"ID":"95fe306c-2145-4279-83c4-850ad0c4c892","Type":"ContainerDied","Data":"635c14247e14bab56bdf29beaa7c562fd507b5a97abd6c6a841aac05cc004bfa"} Jul 20 16:08:04.644178 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:04.644175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" event={"ID":"95fe306c-2145-4279-83c4-850ad0c4c892","Type":"ContainerStarted","Data":"b39a2063e0f6491cd7d69bedacaaf8fd0842379220f5f11533ee5e4cb6405285"} Jul 20 16:08:07.659328 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:07.659292 2561 generic.go:356] "Generic (PLEG): container finished" podID="95fe306c-2145-4279-83c4-850ad0c4c892" containerID="183d3968a654cb2b9eb9f8ce943894db270927f64f2ee953e65e9a2c724b2860" exitCode=0 Jul 20 16:08:07.659708 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:07.659373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" event={"ID":"95fe306c-2145-4279-83c4-850ad0c4c892","Type":"ContainerDied","Data":"183d3968a654cb2b9eb9f8ce943894db270927f64f2ee953e65e9a2c724b2860"} Jul 20 16:08:08.665738 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:08.665702 2561 generic.go:356] "Generic (PLEG): container finished" podID="95fe306c-2145-4279-83c4-850ad0c4c892" containerID="1458de08b50331b962e9fb1d185bd5d4b2904cd73ff16c3440d1d00744f8ea3b" exitCode=0 Jul 20 16:08:08.666113 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:08.665778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" event={"ID":"95fe306c-2145-4279-83c4-850ad0c4c892","Type":"ContainerDied","Data":"1458de08b50331b962e9fb1d185bd5d4b2904cd73ff16c3440d1d00744f8ea3b"} Jul 20 16:08:09.796195 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.796168 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:09.885776 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.885750 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-bundle\") pod \"95fe306c-2145-4279-83c4-850ad0c4c892\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " Jul 20 16:08:09.887900 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.886122 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r86tp\" (UniqueName: \"kubernetes.io/projected/95fe306c-2145-4279-83c4-850ad0c4c892-kube-api-access-r86tp\") pod \"95fe306c-2145-4279-83c4-850ad0c4c892\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " Jul 20 16:08:09.887900 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.886370 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-bundle" (OuterVolumeSpecName: "bundle") pod "95fe306c-2145-4279-83c4-850ad0c4c892" (UID: "95fe306c-2145-4279-83c4-850ad0c4c892"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:08:09.891443 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.888116 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-util\") pod \"95fe306c-2145-4279-83c4-850ad0c4c892\" (UID: \"95fe306c-2145-4279-83c4-850ad0c4c892\") " Jul 20 16:08:09.891443 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.888518 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:08:09.891907 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.891826 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95fe306c-2145-4279-83c4-850ad0c4c892-kube-api-access-r86tp" (OuterVolumeSpecName: "kube-api-access-r86tp") pod "95fe306c-2145-4279-83c4-850ad0c4c892" (UID: "95fe306c-2145-4279-83c4-850ad0c4c892"). InnerVolumeSpecName "kube-api-access-r86tp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:08:09.893758 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.893701 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-util" (OuterVolumeSpecName: "util") pod "95fe306c-2145-4279-83c4-850ad0c4c892" (UID: "95fe306c-2145-4279-83c4-850ad0c4c892"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:08:09.989387 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.989314 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r86tp\" (UniqueName: \"kubernetes.io/projected/95fe306c-2145-4279-83c4-850ad0c4c892-kube-api-access-r86tp\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:08:09.989387 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:09.989340 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95fe306c-2145-4279-83c4-850ad0c4c892-util\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:08:10.676306 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:10.676274 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" Jul 20 16:08:10.676306 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:10.676292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e7gpwl" event={"ID":"95fe306c-2145-4279-83c4-850ad0c4c892","Type":"ContainerDied","Data":"b39a2063e0f6491cd7d69bedacaaf8fd0842379220f5f11533ee5e4cb6405285"} Jul 20 16:08:10.676510 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:10.676346 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b39a2063e0f6491cd7d69bedacaaf8fd0842379220f5f11533ee5e4cb6405285" Jul 20 16:08:16.324128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324095 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-76z4c"] Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324383 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="extract" Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324394 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="extract" Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324404 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="util" Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324410 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="util" Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324425 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="pull" Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324430 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="pull" Jul 20 16:08:16.324602 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.324476 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fe306c-2145-4279-83c4-850ad0c4c892" containerName="extract" Jul 20 16:08:16.326764 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.326749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.328796 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.328772 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 20 16:08:16.329462 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.329437 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:08:16.329462 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.329509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-ss9xk\"" Jul 20 16:08:16.334793 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.334764 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-76z4c"] Jul 20 16:08:16.437804 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.437772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdm28\" (UniqueName: \"kubernetes.io/projected/74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec-kube-api-access-fdm28\") pod \"jobset-operator-5bc45f897-76z4c\" (UID: \"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.438009 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.437830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec-tmp\") pod \"jobset-operator-5bc45f897-76z4c\" (UID: \"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.549549 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.549507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdm28\" (UniqueName: \"kubernetes.io/projected/74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec-kube-api-access-fdm28\") pod \"jobset-operator-5bc45f897-76z4c\" (UID: \"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.549754 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.549605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec-tmp\") pod \"jobset-operator-5bc45f897-76z4c\" (UID: \"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.555822 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.550009 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec-tmp\") pod \"jobset-operator-5bc45f897-76z4c\" (UID: \"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.557189 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.557160 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdm28\" (UniqueName: \"kubernetes.io/projected/74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec-kube-api-access-fdm28\") pod \"jobset-operator-5bc45f897-76z4c\" (UID: \"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.636751 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.636679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" Jul 20 16:08:16.759641 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:16.759610 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-76z4c"] Jul 20 16:08:16.762476 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:08:16.762448 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74ec0bbb_aad3_4f7e_9e30_3500fe39a7ec.slice/crio-7f4d1bb02a7de9b60866333a9797f497b0a604443f85f6e286e33599099b6f87 WatchSource:0}: Error finding container 7f4d1bb02a7de9b60866333a9797f497b0a604443f85f6e286e33599099b6f87: Status 404 returned error can't find the container with id 7f4d1bb02a7de9b60866333a9797f497b0a604443f85f6e286e33599099b6f87 Jul 20 16:08:17.710013 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:17.709973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" event={"ID":"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec","Type":"ContainerStarted","Data":"7f4d1bb02a7de9b60866333a9797f497b0a604443f85f6e286e33599099b6f87"} Jul 20 16:08:18.715453 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:18.715370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" event={"ID":"74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec","Type":"ContainerStarted","Data":"b458c535c9ab01a5d0a5c4fd96bc87450d465707d365b16fec2f1cfde16c3f90"} Jul 20 16:08:18.730098 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:18.730042 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-76z4c" podStartSLOduration=1.089761711 podStartE2EDuration="2.730026861s" totalImagesPullingTime="1.64026515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:08:18.728215476 +0000 UTC m=+276.792586721" watchObservedRunningTime="2026-07-20 16:08:18.730026861 +0000 UTC m=+276.794398107" Jul 20 16:08:42.319573 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:42.319549 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:08:42.323992 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:42.323960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:08:42.325528 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:08:42.325507 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 16:09:30.707247 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.707214 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j"] Jul 20 16:09:30.709644 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.709611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.711752 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.711730 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 20 16:09:30.712360 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.712336 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-z5m7b\"" Jul 20 16:09:30.712360 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.712356 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 20 16:09:30.719948 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.719930 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j"] Jul 20 16:09:30.821499 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.821469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a90109d5-ab46-4889-968f-69b50d9737de-tmp\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.821619 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.821519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/a90109d5-ab46-4889-968f-69b50d9737de-manifests-work\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.821619 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.821603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glftz\" (UniqueName: \"kubernetes.io/projected/a90109d5-ab46-4889-968f-69b50d9737de-kube-api-access-glftz\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.922119 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.922084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a90109d5-ab46-4889-968f-69b50d9737de-tmp\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.922307 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.922128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/a90109d5-ab46-4889-968f-69b50d9737de-manifests-work\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.922307 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.922184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glftz\" (UniqueName: \"kubernetes.io/projected/a90109d5-ab46-4889-968f-69b50d9737de-kube-api-access-glftz\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.922548 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.922524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a90109d5-ab46-4889-968f-69b50d9737de-tmp\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.922617 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.922539 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/a90109d5-ab46-4889-968f-69b50d9737de-manifests-work\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:30.930076 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:30.930047 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glftz\" (UniqueName: \"kubernetes.io/projected/a90109d5-ab46-4889-968f-69b50d9737de-kube-api-access-glftz\") pod \"trainer-operator-controller-manager-d5bf5b8d-b275j\" (UID: \"a90109d5-ab46-4889-968f-69b50d9737de\") " pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:31.019898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:31.019874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:31.143592 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:31.143569 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j"] Jul 20 16:09:31.145828 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:09:31.145793 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90109d5_ab46_4889_968f_69b50d9737de.slice/crio-03f36c0c7e7f43b4235b4cf4db95dd658893d343133d9b6060cb70fc154cdf56 WatchSource:0}: Error finding container 03f36c0c7e7f43b4235b4cf4db95dd658893d343133d9b6060cb70fc154cdf56: Status 404 returned error can't find the container with id 03f36c0c7e7f43b4235b4cf4db95dd658893d343133d9b6060cb70fc154cdf56 Jul 20 16:09:31.147686 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:31.147670 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:09:32.017163 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:32.017107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" event={"ID":"a90109d5-ab46-4889-968f-69b50d9737de","Type":"ContainerStarted","Data":"03f36c0c7e7f43b4235b4cf4db95dd658893d343133d9b6060cb70fc154cdf56"} Jul 20 16:09:34.029256 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:34.029219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" event={"ID":"a90109d5-ab46-4889-968f-69b50d9737de","Type":"ContainerStarted","Data":"d6bc11355ade86eb5e7c185f64b9bdf2f7a9078431a325a2bc7f2189da13e312"} Jul 20 16:09:34.029675 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:34.029348 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:09:34.043485 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:34.043396 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" podStartSLOduration=1.645923243 podStartE2EDuration="4.043383747s" totalImagesPullingTime="2.397460504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:34.043085636 +0000 UTC m=+352.107456879" watchObservedRunningTime="2026-07-20 16:09:34.043383747 +0000 UTC m=+352.107754992" Jul 20 16:09:45.035408 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:09:45.035374 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-d5bf5b8d-b275j" Jul 20 16:10:18.763541 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.763509 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z"] Jul 20 16:10:18.768439 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.768417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.770354 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.770332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 20 16:10:18.770451 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.770372 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 20 16:10:18.770562 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.770548 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 16:10:18.771063 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.771045 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 16:10:18.771156 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.771073 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-5vfcx\"" Jul 20 16:10:18.775765 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.775741 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z"] Jul 20 16:10:18.887128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.887097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.887128 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.887149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsg6n\" (UniqueName: \"kubernetes.io/projected/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kube-api-access-tsg6n\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.887384 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.887298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.988241 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.988196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.988241 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.988252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.988493 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.988272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsg6n\" (UniqueName: \"kubernetes.io/projected/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kube-api-access-tsg6n\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.988940 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.988915 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.990593 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.990573 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:18.995324 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:18.995304 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsg6n\" (UniqueName: \"kubernetes.io/projected/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kube-api-access-tsg6n\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:19.078562 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:19.078471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:19.208567 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:19.208535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z"] Jul 20 16:10:19.212063 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:10:19.212037 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeb8eb28_3fef_4cfe_9810_f5c4c0e47ff8.slice/crio-60aa835164daabfb030948165f7dea3812089f67bdc5a918fec506c167cc151d WatchSource:0}: Error finding container 60aa835164daabfb030948165f7dea3812089f67bdc5a918fec506c167cc151d: Status 404 returned error can't find the container with id 60aa835164daabfb030948165f7dea3812089f67bdc5a918fec506c167cc151d Jul 20 16:10:19.220663 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:19.220636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" event={"ID":"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8","Type":"ContainerStarted","Data":"60aa835164daabfb030948165f7dea3812089f67bdc5a918fec506c167cc151d"} Jul 20 16:10:22.241203 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:22.241163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" event={"ID":"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8","Type":"ContainerStarted","Data":"aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9"} Jul 20 16:10:22.241583 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:22.241288 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:22.256238 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:22.256184 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" podStartSLOduration=1.744319841 podStartE2EDuration="4.256165822s" totalImagesPullingTime="2.511845981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:22.254808643 +0000 UTC m=+400.319179890" watchObservedRunningTime="2026-07-20 16:10:22.256165822 +0000 UTC m=+400.320537063" Jul 20 16:10:32.504154 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:32.504106 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-974f8fb75-mxdn8"] Jul 20 16:10:38.251035 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:38.251003 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:10:40.875185 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:40.875151 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-kfrvj"] Jul 20 16:10:40.877345 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:40.877320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:10:40.879143 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:40.879113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tmghw\"" Jul 20 16:10:40.888201 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:40.888181 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-kfrvj"] Jul 20 16:10:40.978427 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:40.978395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbh2\" (UniqueName: \"kubernetes.io/projected/6fb1004b-0906-4341-8833-d775f1c0709b-kube-api-access-lhbh2\") pod \"test-trainjob-workflow-node-0-0-kfrvj\" (UID: \"6fb1004b-0906-4341-8833-d775f1c0709b\") " pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:10:41.079185 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:41.079153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbh2\" (UniqueName: \"kubernetes.io/projected/6fb1004b-0906-4341-8833-d775f1c0709b-kube-api-access-lhbh2\") pod \"test-trainjob-workflow-node-0-0-kfrvj\" (UID: \"6fb1004b-0906-4341-8833-d775f1c0709b\") " pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:10:41.087101 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:41.087081 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbh2\" (UniqueName: \"kubernetes.io/projected/6fb1004b-0906-4341-8833-d775f1c0709b-kube-api-access-lhbh2\") pod \"test-trainjob-workflow-node-0-0-kfrvj\" (UID: \"6fb1004b-0906-4341-8833-d775f1c0709b\") " pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:10:41.186273 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:41.186204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:10:41.308373 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:41.308302 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-kfrvj"] Jul 20 16:10:41.310582 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:10:41.310554 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fb1004b_0906_4341_8833_d775f1c0709b.slice/crio-82e021edc7e2ad1752d56ef416b2a1b108e2c19998105e24d437443ec8e65039 WatchSource:0}: Error finding container 82e021edc7e2ad1752d56ef416b2a1b108e2c19998105e24d437443ec8e65039: Status 404 returned error can't find the container with id 82e021edc7e2ad1752d56ef416b2a1b108e2c19998105e24d437443ec8e65039 Jul 20 16:10:41.327835 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:41.327808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" event={"ID":"6fb1004b-0906-4341-8833-d775f1c0709b","Type":"ContainerStarted","Data":"82e021edc7e2ad1752d56ef416b2a1b108e2c19998105e24d437443ec8e65039"} Jul 20 16:10:57.527941 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:57.527869 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-974f8fb75-mxdn8" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerName="console" containerID="cri-o://8344e02e9eed43952e14e95caa438f335fdd1d192c0f48600534b90caa987d95" gracePeriod=15 Jul 20 16:10:59.311548 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:59.311515 2561 patch_prober.go:28] interesting pod/console-974f8fb75-mxdn8 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jul 20 16:10:59.311974 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:10:59.311571 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-974f8fb75-mxdn8" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jul 20 16:11:05.471046 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:05.471004 2561 generic.go:356] "Generic (PLEG): container finished" podID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerID="8344e02e9eed43952e14e95caa438f335fdd1d192c0f48600534b90caa987d95" exitCode=0 Jul 20 16:11:05.471661 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:05.471093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-974f8fb75-mxdn8" event={"ID":"ded1cdf5-716b-4d95-a58f-44a15264e126","Type":"ContainerDied","Data":"8344e02e9eed43952e14e95caa438f335fdd1d192c0f48600534b90caa987d95"} Jul 20 16:11:10.311568 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:10.311521 2561 patch_prober.go:28] interesting pod/console-974f8fb75-mxdn8 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.17:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:11:10.312147 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:10.311596 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-974f8fb75-mxdn8" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 20 16:11:12.083952 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.083924 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:11:12.154917 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.154889 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-oauth-serving-cert\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155047 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.154942 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-serving-cert\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155087 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155053 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-service-ca\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155127 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155090 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz8jb\" (UniqueName: \"kubernetes.io/projected/ded1cdf5-716b-4d95-a58f-44a15264e126-kube-api-access-xz8jb\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155199 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155148 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-console-config\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155243 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155197 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-oauth-config\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155243 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155230 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-trusted-ca-bundle\") pod \"ded1cdf5-716b-4d95-a58f-44a15264e126\" (UID: \"ded1cdf5-716b-4d95-a58f-44a15264e126\") " Jul 20 16:11:12.155406 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155373 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:12.155529 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155480 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.155529 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155488 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-service-ca" (OuterVolumeSpecName: "service-ca") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:12.155529 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155490 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-console-config" (OuterVolumeSpecName: "console-config") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:12.155753 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.155731 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:12.157191 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.157151 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded1cdf5-716b-4d95-a58f-44a15264e126-kube-api-access-xz8jb" (OuterVolumeSpecName: "kube-api-access-xz8jb") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "kube-api-access-xz8jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:11:12.157288 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.157227 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:12.157288 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.157245 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ded1cdf5-716b-4d95-a58f-44a15264e126" (UID: "ded1cdf5-716b-4d95-a58f-44a15264e126"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:12.256146 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.256101 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.256146 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.256143 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.256329 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.256156 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ded1cdf5-716b-4d95-a58f-44a15264e126-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.256329 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.256170 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.256329 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.256182 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz8jb\" (UniqueName: \"kubernetes.io/projected/ded1cdf5-716b-4d95-a58f-44a15264e126-kube-api-access-xz8jb\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.256329 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.256194 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ded1cdf5-716b-4d95-a58f-44a15264e126-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:12.511384 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.511356 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-974f8fb75-mxdn8" Jul 20 16:11:12.511554 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.511393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-974f8fb75-mxdn8" event={"ID":"ded1cdf5-716b-4d95-a58f-44a15264e126","Type":"ContainerDied","Data":"d21f02d68e5e666a8106a1f5e06284a14303076676adf58799d2eabd1d8f8bbb"} Jul 20 16:11:12.511554 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.511453 2561 scope.go:117] "RemoveContainer" containerID="8344e02e9eed43952e14e95caa438f335fdd1d192c0f48600534b90caa987d95" Jul 20 16:11:12.538726 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.538663 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-974f8fb75-mxdn8"] Jul 20 16:11:12.541030 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:12.541006 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-974f8fb75-mxdn8"] Jul 20 16:11:14.519567 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:14.519527 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" path="/var/lib/kubelet/pods/ded1cdf5-716b-4d95-a58f-44a15264e126/volumes" Jul 20 16:11:53.710894 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:53.710853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" event={"ID":"6fb1004b-0906-4341-8833-d775f1c0709b","Type":"ContainerStarted","Data":"9e7528b8332caf155759a39ba09041f2f3655fca1e6a93f3867d61a64d9b75c8"} Jul 20 16:11:53.725726 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:53.725669 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" podStartSLOduration=2.2593932150000002 podStartE2EDuration="1m13.725650193s" totalImagesPullingTime="1m11.466256978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:11:53.724255272 +0000 UTC m=+491.788626520" watchObservedRunningTime="2026-07-20 16:11:53.725650193 +0000 UTC m=+491.790021440" Jul 20 16:11:55.720303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:55.720226 2561 generic.go:356] "Generic (PLEG): container finished" podID="6fb1004b-0906-4341-8833-d775f1c0709b" containerID="9e7528b8332caf155759a39ba09041f2f3655fca1e6a93f3867d61a64d9b75c8" exitCode=0 Jul 20 16:11:55.720303 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:55.720284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" event={"ID":"6fb1004b-0906-4341-8833-d775f1c0709b","Type":"ContainerDied","Data":"9e7528b8332caf155759a39ba09041f2f3655fca1e6a93f3867d61a64d9b75c8"} Jul 20 16:11:56.877939 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:56.877914 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:11:56.937477 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:56.937444 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhbh2\" (UniqueName: \"kubernetes.io/projected/6fb1004b-0906-4341-8833-d775f1c0709b-kube-api-access-lhbh2\") pod \"6fb1004b-0906-4341-8833-d775f1c0709b\" (UID: \"6fb1004b-0906-4341-8833-d775f1c0709b\") " Jul 20 16:11:56.939609 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:56.939572 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb1004b-0906-4341-8833-d775f1c0709b-kube-api-access-lhbh2" (OuterVolumeSpecName: "kube-api-access-lhbh2") pod "6fb1004b-0906-4341-8833-d775f1c0709b" (UID: "6fb1004b-0906-4341-8833-d775f1c0709b"). InnerVolumeSpecName "kube-api-access-lhbh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:11:57.038699 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:57.038674 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhbh2\" (UniqueName: \"kubernetes.io/projected/6fb1004b-0906-4341-8833-d775f1c0709b-kube-api-access-lhbh2\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:57.730004 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:57.729968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" event={"ID":"6fb1004b-0906-4341-8833-d775f1c0709b","Type":"ContainerDied","Data":"82e021edc7e2ad1752d56ef416b2a1b108e2c19998105e24d437443ec8e65039"} Jul 20 16:11:57.730004 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:57.730009 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82e021edc7e2ad1752d56ef416b2a1b108e2c19998105e24d437443ec8e65039" Jul 20 16:11:57.730333 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:57.729979 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-kfrvj" Jul 20 16:11:58.178358 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.178327 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-kfrvj"] Jul 20 16:11:58.181529 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.181506 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-kfrvj"] Jul 20 16:11:58.305389 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.305353 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z"] Jul 20 16:11:58.305569 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.305518 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" podUID="feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" containerName="manager" containerID="cri-o://aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9" gracePeriod=30 Jul 20 16:11:58.519823 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.519795 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb1004b-0906-4341-8833-d775f1c0709b" path="/var/lib/kubelet/pods/6fb1004b-0906-4341-8833-d775f1c0709b/volumes" Jul 20 16:11:58.553393 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553357 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2fpb4/must-gather-6fjxb"] Jul 20 16:11:58.553691 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553675 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerName="console" Jul 20 16:11:58.553783 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553695 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerName="console" Jul 20 16:11:58.553783 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553725 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb1004b-0906-4341-8833-d775f1c0709b" containerName="node" Jul 20 16:11:58.553783 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553734 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb1004b-0906-4341-8833-d775f1c0709b" containerName="node" Jul 20 16:11:58.553935 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553814 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb1004b-0906-4341-8833-d775f1c0709b" containerName="node" Jul 20 16:11:58.553935 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.553829 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded1cdf5-716b-4d95-a58f-44a15264e126" containerName="console" Jul 20 16:11:58.579881 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.579849 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2fpb4/must-gather-6fjxb"] Jul 20 16:11:58.580022 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.579953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.582234 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.582211 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2fpb4\"/\"openshift-service-ca.crt\"" Jul 20 16:11:58.582363 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.582244 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2fpb4\"/\"kube-root-ca.crt\"" Jul 20 16:11:58.582363 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.582260 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2fpb4\"/\"default-dockercfg-wtp2w\"" Jul 20 16:11:58.594998 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.594970 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:11:58.651279 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.651244 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsg6n\" (UniqueName: \"kubernetes.io/projected/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kube-api-access-tsg6n\") pod \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " Jul 20 16:11:58.651458 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.651304 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kubeflow-trainer-config\") pod \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " Jul 20 16:11:58.651458 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.651353 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-cert\") pod \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\" (UID: \"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8\") " Jul 20 16:11:58.651458 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.651428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-must-gather-output\") pod \"must-gather-6fjxb\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.651458 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.651452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkm7q\" (UniqueName: \"kubernetes.io/projected/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-kube-api-access-kkm7q\") pod \"must-gather-6fjxb\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.653361 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.653335 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kube-api-access-tsg6n" (OuterVolumeSpecName: "kube-api-access-tsg6n") pod "feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" (UID: "feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8"). InnerVolumeSpecName "kube-api-access-tsg6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:11:58.653482 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.653393 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-cert" (OuterVolumeSpecName: "cert") pod "feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" (UID: "feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:58.655810 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.655787 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" (UID: "feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:58.735769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.735698 2561 generic.go:356] "Generic (PLEG): container finished" podID="feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" containerID="aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9" exitCode=0 Jul 20 16:11:58.735769 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.735745 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" Jul 20 16:11:58.735898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.735784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" event={"ID":"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8","Type":"ContainerDied","Data":"aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9"} Jul 20 16:11:58.735898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.735827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z" event={"ID":"feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8","Type":"ContainerDied","Data":"60aa835164daabfb030948165f7dea3812089f67bdc5a918fec506c167cc151d"} Jul 20 16:11:58.735898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.735844 2561 scope.go:117] "RemoveContainer" containerID="aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9" Jul 20 16:11:58.743959 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.743945 2561 scope.go:117] "RemoveContainer" containerID="aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9" Jul 20 16:11:58.744237 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:11:58.744212 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9\": container with ID starting with aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9 not found: ID does not exist" containerID="aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9" Jul 20 16:11:58.744331 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.744238 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9"} err="failed to get container status \"aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9\": rpc error: code = NotFound desc = could not find container \"aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9\": container with ID starting with aef3b453fc6a3aba02b39bfface09d33e7bdb266e7c05ce0dafb6baae003ffd9 not found: ID does not exist" Jul 20 16:11:58.752099 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.752080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-must-gather-output\") pod \"must-gather-6fjxb\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.752187 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.752111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkm7q\" (UniqueName: \"kubernetes.io/projected/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-kube-api-access-kkm7q\") pod \"must-gather-6fjxb\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.752232 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.752201 2561 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kubeflow-trainer-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:58.752232 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.752219 2561 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:58.752365 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.752233 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsg6n\" (UniqueName: \"kubernetes.io/projected/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8-kube-api-access-tsg6n\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:11:58.752522 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.752503 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-must-gather-output\") pod \"must-gather-6fjxb\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.755895 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.755874 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z"] Jul 20 16:11:58.758997 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.758978 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-ctl8z"] Jul 20 16:11:58.759997 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.759977 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkm7q\" (UniqueName: \"kubernetes.io/projected/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-kube-api-access-kkm7q\") pod \"must-gather-6fjxb\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:58.888329 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:58.888299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:11:59.042761 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:59.042729 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2fpb4/must-gather-6fjxb"] Jul 20 16:11:59.045391 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:11:59.045364 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d6fbb53_1ee2_4b9b_8d5c_29d0d49a13d2.slice/crio-ada0329b1f45eafa62b9d67602131fc97c4a2668fb0b6361bc1e9efe5d274005 WatchSource:0}: Error finding container ada0329b1f45eafa62b9d67602131fc97c4a2668fb0b6361bc1e9efe5d274005: Status 404 returned error can't find the container with id ada0329b1f45eafa62b9d67602131fc97c4a2668fb0b6361bc1e9efe5d274005 Jul 20 16:11:59.743629 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:11:59.743588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" event={"ID":"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2","Type":"ContainerStarted","Data":"ada0329b1f45eafa62b9d67602131fc97c4a2668fb0b6361bc1e9efe5d274005"} Jul 20 16:12:00.520429 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:00.520396 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" path="/var/lib/kubelet/pods/feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8/volumes" Jul 20 16:12:06.781593 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:06.781552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" event={"ID":"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2","Type":"ContainerStarted","Data":"0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6"} Jul 20 16:12:06.781593 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:06.781602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" event={"ID":"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2","Type":"ContainerStarted","Data":"31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0"} Jul 20 16:12:06.795894 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:06.795838 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" podStartSLOduration=2.06034699 podStartE2EDuration="8.795822272s" totalImagesPullingTime="6.735475282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:12:06.793586067 +0000 UTC m=+504.857957313" watchObservedRunningTime="2026-07-20 16:12:06.795822272 +0000 UTC m=+504.860193522" Jul 20 16:12:52.006398 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:52.006364 2561 generic.go:356] "Generic (PLEG): container finished" podID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerID="31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0" exitCode=0 Jul 20 16:12:52.006919 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:52.006439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" event={"ID":"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2","Type":"ContainerDied","Data":"31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0"} Jul 20 16:12:52.006919 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:52.006841 2561 scope.go:117] "RemoveContainer" containerID="31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0" Jul 20 16:12:52.800836 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:52.800782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2fpb4_must-gather-6fjxb_4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2/gather/0.log" Jul 20 16:12:55.976424 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:55.976388 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lg4gm_b80ed257-9e45-4dd1-8aa6-50ce830b110a/global-pull-secret-syncer/0.log" Jul 20 16:12:56.113481 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:56.113452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vp7f2_e7cf47b8-96c8-4032-94a6-e51eff1bdc8d/konnectivity-agent/0.log" Jul 20 16:12:56.136001 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:56.135972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-222.ec2.internal_36e3f13071d6e65e613de042ac860efb/haproxy/0.log" Jul 20 16:12:58.133592 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.133557 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2fpb4/must-gather-6fjxb"] Jul 20 16:12:58.134064 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.133737 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="copy" containerID="cri-o://0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6" gracePeriod=2 Jul 20 16:12:58.140327 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.140301 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2fpb4/must-gather-6fjxb"] Jul 20 16:12:58.140948 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:12:58.140919 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-2fpb4\"/\"must-gather-6fjxb\": pods \"must-gather-6fjxb\" not found" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:12:58.365028 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.365007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2fpb4_must-gather-6fjxb_4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2/copy/0.log" Jul 20 16:12:58.366554 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.366537 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:12:58.368061 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:12:58.368041 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6fjxb\" is forbidden: User \"system:node:ip-10-0-129-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2fpb4\": no relationship found between node 'ip-10-0-129-222.ec2.internal' and this object" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:12:58.447991 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.447910 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkm7q\" (UniqueName: \"kubernetes.io/projected/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-kube-api-access-kkm7q\") pod \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " Jul 20 16:12:58.449978 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.449958 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-kube-api-access-kkm7q" (OuterVolumeSpecName: "kube-api-access-kkm7q") pod "4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" (UID: "4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2"). InnerVolumeSpecName "kube-api-access-kkm7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:12:58.549023 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.548994 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-must-gather-output\") pod \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\" (UID: \"4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2\") " Jul 20 16:12:58.549354 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.549317 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkm7q\" (UniqueName: \"kubernetes.io/projected/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-kube-api-access-kkm7q\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:12:58.550351 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.550329 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" (UID: "4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:12:58.650313 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:58.650286 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2-must-gather-output\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 20 16:12:59.037371 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.037343 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2fpb4_must-gather-6fjxb_4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2/copy/0.log" Jul 20 16:12:59.037720 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.037699 2561 generic.go:356] "Generic (PLEG): container finished" podID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerID="0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6" exitCode=143 Jul 20 16:12:59.037774 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.037756 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fpb4/must-gather-6fjxb" Jul 20 16:12:59.037821 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.037805 2561 scope.go:117] "RemoveContainer" containerID="0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6" Jul 20 16:12:59.045581 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.045564 2561 scope.go:117] "RemoveContainer" containerID="31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0" Jul 20 16:12:59.057927 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.057911 2561 scope.go:117] "RemoveContainer" containerID="0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6" Jul 20 16:12:59.058188 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:12:59.058167 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6\": container with ID starting with 0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6 not found: ID does not exist" containerID="0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6" Jul 20 16:12:59.058241 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.058198 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6"} err="failed to get container status \"0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6\": rpc error: code = NotFound desc = could not find container \"0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6\": container with ID starting with 0683e5442b63ce3ad5e8224c1dd75f9e20b96b3c361bb3b9f7109f7ee50a15a6 not found: ID does not exist" Jul 20 16:12:59.058241 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.058217 2561 scope.go:117] "RemoveContainer" containerID="31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0" Jul 20 16:12:59.058448 ip-10-0-129-222 kubenswrapper[2561]: E0720 16:12:59.058429 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0\": container with ID starting with 31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0 not found: ID does not exist" containerID="31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0" Jul 20 16:12:59.058497 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:12:59.058456 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0"} err="failed to get container status \"31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0\": rpc error: code = NotFound desc = could not find container \"31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0\": container with ID starting with 31fb77ec41d828db68cf8bc15ab8cc931bd1456e7cf4981ae409d826baf6b6b0 not found: ID does not exist" Jul 20 16:13:00.240146 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.240103 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-m7zhj_fec8b8ab-1875-48ae-a657-1b11b704cd29/monitoring-plugin/0.log" Jul 20 16:13:00.269898 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.269873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wbvh_4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e/node-exporter/0.log" Jul 20 16:13:00.288515 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.288495 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wbvh_4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e/kube-rbac-proxy/0.log" Jul 20 16:13:00.318574 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.318556 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wbvh_4cb9cf83-cf46-428f-b4f1-01cb10c4fc7e/init-textfile/0.log" Jul 20 16:13:00.518974 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.518947 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" path="/var/lib/kubelet/pods/4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2/volumes" Jul 20 16:13:00.790928 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.790841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-m68s9_dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988/prometheus-operator/0.log" Jul 20 16:13:00.811573 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.811548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-m68s9_dfb6a04c-1b4b-4a3f-b6ca-36d57a7c9988/kube-rbac-proxy/0.log" Jul 20 16:13:00.869694 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.869671 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f55659d96-bcs8c_7aeed1b4-bf3e-4090-9987-f775a2cfcfbf/telemeter-client/0.log" Jul 20 16:13:00.890654 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.890630 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f55659d96-bcs8c_7aeed1b4-bf3e-4090-9987-f775a2cfcfbf/reload/0.log" Jul 20 16:13:00.910581 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.910562 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f55659d96-bcs8c_7aeed1b4-bf3e-4090-9987-f775a2cfcfbf/kube-rbac-proxy/0.log" Jul 20 16:13:00.941932 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.941913 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d489f488-ls62g_ce6377bb-be27-4b61-bf97-04c096e5430d/thanos-query/0.log" Jul 20 16:13:00.962660 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.962624 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d489f488-ls62g_ce6377bb-be27-4b61-bf97-04c096e5430d/kube-rbac-proxy-web/0.log" Jul 20 16:13:00.982950 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:00.982928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d489f488-ls62g_ce6377bb-be27-4b61-bf97-04c096e5430d/kube-rbac-proxy/0.log" Jul 20 16:13:01.002953 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:01.002928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d489f488-ls62g_ce6377bb-be27-4b61-bf97-04c096e5430d/prom-label-proxy/0.log" Jul 20 16:13:01.022527 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:01.022506 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d489f488-ls62g_ce6377bb-be27-4b61-bf97-04c096e5430d/kube-rbac-proxy-rules/0.log" Jul 20 16:13:01.042680 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:01.042584 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d489f488-ls62g_ce6377bb-be27-4b61-bf97-04c096e5430d/kube-rbac-proxy-metrics/0.log" Jul 20 16:13:03.246479 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:03.246452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-d6qxd_ac59cd04-a40a-4255-8483-fc4a042d2c51/download-server/0.log" Jul 20 16:13:04.480845 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.480809 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd"] Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481101 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="copy" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481112 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="copy" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481129 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="gather" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481152 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="gather" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481164 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" containerName="manager" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481172 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" containerName="manager" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481235 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb8eb28-3fef-4cfe-9810-f5c4c0e47ff8" containerName="manager" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481244 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="gather" Jul 20 16:13:04.481248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.481252 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d6fbb53-1ee2-4b9b-8d5c-29d0d49a13d2" containerName="copy" Jul 20 16:13:04.484875 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.484853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.485493 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.485469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-proc\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.485557 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.485520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-podres\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.485594 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.485552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-lib-modules\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.485714 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.485690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-sys\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.485858 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.485724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757hw\" (UniqueName: \"kubernetes.io/projected/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-kube-api-access-757hw\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.486804 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.486789 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rsjp7\"/\"kube-root-ca.crt\"" Jul 20 16:13:04.486884 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.486810 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rsjp7\"/\"openshift-service-ca.crt\"" Jul 20 16:13:04.487341 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.487324 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rsjp7\"/\"default-dockercfg-mtbsz\"" Jul 20 16:13:04.493392 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.493373 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd"] Jul 20 16:13:04.586197 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-sys\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586197 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-757hw\" (UniqueName: \"kubernetes.io/projected/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-kube-api-access-757hw\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-proc\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-podres\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-lib-modules\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586316 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-proc\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586317 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-sys\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586374 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-podres\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.586432 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.586386 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-lib-modules\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.593008 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.592986 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-757hw\" (UniqueName: \"kubernetes.io/projected/0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a-kube-api-access-757hw\") pod \"perf-node-gather-daemonset-tv7kd\" (UID: \"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a\") " pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.644509 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.644486 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j2s45_2fd71527-5a1c-4ad1-9212-fd30f3a0a768/dns/0.log" Jul 20 16:13:04.662694 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.662672 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j2s45_2fd71527-5a1c-4ad1-9212-fd30f3a0a768/kube-rbac-proxy/0.log" Jul 20 16:13:04.725594 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.725574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49smd_4879f980-bdcd-4812-8ec3-3d827720ef34/dns-node-resolver/0.log" Jul 20 16:13:04.795500 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.795481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:04.920575 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:04.920550 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd"] Jul 20 16:13:04.922829 ip-10-0-129-222 kubenswrapper[2561]: W0720 16:13:04.922800 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f7ebcb6_9dd2_42c7_96f6_b6f7829f139a.slice/crio-d7a0c2de8fdceae3eafadae224348d57b64eab7db84fd27ccbf929633cfc5996 WatchSource:0}: Error finding container d7a0c2de8fdceae3eafadae224348d57b64eab7db84fd27ccbf929633cfc5996: Status 404 returned error can't find the container with id d7a0c2de8fdceae3eafadae224348d57b64eab7db84fd27ccbf929633cfc5996 Jul 20 16:13:05.065056 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:05.065030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" event={"ID":"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a","Type":"ContainerStarted","Data":"077c4ee88c17416281c6a582caed0e1d8170f0c6b465f9fe7fd1aeb09a5c7221"} Jul 20 16:13:05.065190 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:05.065117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" event={"ID":"0f7ebcb6-9dd2-42c7-96f6-b6f7829f139a","Type":"ContainerStarted","Data":"d7a0c2de8fdceae3eafadae224348d57b64eab7db84fd27ccbf929633cfc5996"} Jul 20 16:13:05.065190 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:05.065173 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:05.077805 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:05.077767 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" podStartSLOduration=1.077754929 podStartE2EDuration="1.077754929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:13:05.076993141 +0000 UTC m=+563.141364387" watchObservedRunningTime="2026-07-20 16:13:05.077754929 +0000 UTC m=+563.142126174" Jul 20 16:13:05.237658 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:05.237632 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c757d75b8-z9s4r_84ed4e7d-0efa-4422-b022-5668169bfabb/registry/0.log" Jul 20 16:13:05.256942 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:05.256922 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8jpp7_e02403fa-5b38-4044-92da-80c18792e936/node-ca/0.log" Jul 20 16:13:06.359309 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:06.359278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6pjbj_94173252-79f6-4352-b9d4-e8185121721a/serve-healthcheck-canary/0.log" Jul 20 16:13:06.856591 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:06.856558 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q76dr_099e46af-8b56-4761-97f3-c42df0ce3bb6/kube-rbac-proxy/0.log" Jul 20 16:13:06.875089 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:06.875058 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q76dr_099e46af-8b56-4761-97f3-c42df0ce3bb6/exporter/0.log" Jul 20 16:13:06.894320 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:06.894277 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q76dr_099e46af-8b56-4761-97f3-c42df0ce3bb6/extractor/0.log" Jul 20 16:13:08.532424 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:08.532399 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-76z4c_74ec0bbb-aad3-4f7e-9e30-3500fe39a7ec/jobset-operator/0.log" Jul 20 16:13:11.078629 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:11.078604 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rsjp7/perf-node-gather-daemonset-tv7kd" Jul 20 16:13:12.806426 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.806396 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/kube-multus-additional-cni-plugins/0.log" Jul 20 16:13:12.831516 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.831489 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/egress-router-binary-copy/0.log" Jul 20 16:13:12.850446 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.850427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/cni-plugins/0.log" Jul 20 16:13:12.870627 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.870608 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/bond-cni-plugin/0.log" Jul 20 16:13:12.890618 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.890588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/routeoverride-cni/0.log" Jul 20 16:13:12.909976 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.909955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/whereabouts-cni-bincopy/0.log" Jul 20 16:13:12.931006 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:12.930983 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64qsf_e9845eca-9a3a-4759-858c-840cbf55eb8f/whereabouts-cni/0.log" Jul 20 16:13:13.148351 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:13.148322 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z48tq_1f88379f-4b83-4051-9037-b98682fbf8fd/kube-multus/0.log" Jul 20 16:13:13.215354 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:13.215328 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bq6w5_03a12d1b-e902-413a-85aa-079bb7f165be/network-metrics-daemon/0.log" Jul 20 16:13:13.234843 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:13.234820 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bq6w5_03a12d1b-e902-413a-85aa-079bb7f165be/kube-rbac-proxy/0.log" Jul 20 16:13:14.567091 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.567063 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-controller/0.log" Jul 20 16:13:14.584248 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.584228 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/1.log" Jul 20 16:13:14.584529 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.584515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovn-acl-logging/0.log" Jul 20 16:13:14.599890 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.599866 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/kube-rbac-proxy-node/0.log" Jul 20 16:13:14.618782 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.618760 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 16:13:14.638126 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.638110 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/northd/0.log" Jul 20 16:13:14.656901 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.656879 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/nbdb/0.log" Jul 20 16:13:14.675981 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.675962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/sbdb/0.log" Jul 20 16:13:14.712196 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:14.712171 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbgnt_c7e40387-c86e-4a85-89e3-98532fb247a5/ovnkube-controller/0.log" Jul 20 16:13:15.738978 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:15.738948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5vtwc_9c8dbf78-7129-40b1-b0e4-58c7ad76f843/network-check-target-container/0.log" Jul 20 16:13:16.657948 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:16.657920 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8kdtd_f3ffed43-61eb-4e98-bff8-c881759893af/iptables-alerter/0.log" Jul 20 16:13:17.306682 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:17.306655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dbfgg_bddf6856-69a8-4f33-8625-2c9b5aa3ae33/tuned/0.log" Jul 20 16:13:20.721015 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:20.720990 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mksz6_8394a402-3a19-4295-a492-013903fcf8f9/csi-driver/0.log" Jul 20 16:13:20.740806 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:20.740784 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mksz6_8394a402-3a19-4295-a492-013903fcf8f9/csi-node-driver-registrar/0.log" Jul 20 16:13:20.778355 ip-10-0-129-222 kubenswrapper[2561]: I0720 16:13:20.778329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mksz6_8394a402-3a19-4295-a492-013903fcf8f9/csi-liveness-probe/0.log"