Jul 07 14:07:47.059276 ip-10-0-139-136 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 14:07:47.059287 ip-10-0-139-136 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 14:07:47.059294 ip-10-0-139-136 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 14:07:47.059524 ip-10-0-139-136 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 14:07:58.689306 ip-10-0-139-136 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 14:07:58.689325 ip-10-0-139-136 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 53fb03076cf34f53af198883c33fb291 -- Jul 07 14:09:51.184571 ip-10-0-139-136 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:09:52.944996 ip-10-0-139-136 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:52.944996 ip-10-0-139-136 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:09:52.944996 ip-10-0-139-136 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:52.944996 ip-10-0-139-136 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:09:52.944996 ip-10-0-139-136 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:52.946089 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.945997 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:09:52.949683 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949667 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:52.949683 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949683 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949688 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949691 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949695 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949698 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949701 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949704 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949707 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949710 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949713 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949715 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949718 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949720 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949723 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949725 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949728 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949730 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949733 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949736 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949743 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:52.949751 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949746 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949749 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949751 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949754 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949757 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949760 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949763 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949766 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949768 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949771 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949774 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949776 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949779 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949781 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949784 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949788 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949792 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949795 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949798 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:52.950246 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949800 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949805 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949809 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949812 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949815 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949818 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949821 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949823 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949825 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949828 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949830 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949833 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949835 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949837 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949840 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949843 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949848 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949852 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949855 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:52.950717 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949858 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949861 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949864 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949867 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949869 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949873 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949875 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949878 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949880 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949883 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949886 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949888 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949891 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949894 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949896 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949899 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949901 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949904 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949906 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949909 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:52.951187 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949911 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949914 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949917 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949919 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949922 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949924 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949927 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949930 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949933 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949935 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949938 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949941 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949943 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949946 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949948 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949951 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949953 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949956 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949958 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.949961 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:52.951694 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950663 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950670 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950673 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950675 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950680 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950685 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950688 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950691 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950694 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950696 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950699 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950702 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950705 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950707 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950710 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950712 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950715 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950717 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950720 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:52.952173 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950723 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950734 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950738 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950741 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950744 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950746 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950749 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950752 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950756 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950759 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950762 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950765 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950768 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950770 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950773 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950775 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950778 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950780 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950783 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:52.952656 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950786 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950789 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950791 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950794 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950796 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950799 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950802 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950804 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950807 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950809 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950812 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950816 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950819 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950822 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950825 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950828 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950830 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950833 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950835 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950838 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950841 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:52.953127 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950843 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950845 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950848 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950851 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950853 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950855 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950858 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950861 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950864 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950866 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950868 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950871 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950874 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950876 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950879 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950881 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950884 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950886 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950888 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950891 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:52.953652 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950894 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950896 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950899 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950901 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950905 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950907 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950910 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950912 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950914 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950918 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950922 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950925 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950927 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950930 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950932 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950935 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950937 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950940 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950942 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.950945 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:52.954135 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951339 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951345 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951347 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951350 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951353 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951356 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951359 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951362 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951364 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951367 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951370 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951372 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951375 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951378 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951381 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951383 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951386 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951389 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951392 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951395 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:52.954655 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951398 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951401 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951403 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951406 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951409 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951411 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951414 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951418 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951421 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951423 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951426 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951429 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951431 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951434 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951436 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951439 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951441 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951444 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951447 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951449 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:52.955157 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951451 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951454 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951457 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951459 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951462 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951465 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951467 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951470 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951472 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951475 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951479 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951482 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951485 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951488 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951491 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951493 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951496 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951498 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951501 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:52.955658 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951503 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951506 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951508 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951510 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951514 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951516 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951519 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951521 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951524 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951526 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951528 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951531 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951534 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951536 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951539 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951541 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951544 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951546 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951550 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:52.956151 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951554 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951556 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951559 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951561 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951564 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951566 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951569 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951571 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951574 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951576 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951578 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951581 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951584 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951586 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951589 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951591 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951594 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951596 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951598 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951601 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:52.956622 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.951603 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951676 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951683 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951690 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951694 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951700 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951704 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951708 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951713 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951717 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951720 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951724 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951727 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951730 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951733 2569 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951736 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951739 2569 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951742 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951745 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951751 2569 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951754 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951757 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951760 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951763 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:09:52.957105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951767 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951770 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951774 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951777 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951780 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951783 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951786 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951789 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951792 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951797 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951800 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951802 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951805 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951808 2569 flags.go:64] FLAG: --enable-server="true" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951812 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951816 2569 flags.go:64] FLAG: --event-burst="100" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951819 2569 flags.go:64] FLAG: --event-qps="50" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951822 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951825 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951829 2569 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951833 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951835 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951838 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951841 2569 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951844 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:09:52.957736 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951847 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951850 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951853 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951856 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951859 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951862 2569 flags.go:64] FLAG: --feature-gates="" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951865 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951868 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951872 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951875 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951878 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951881 2569 flags.go:64] FLAG: --help="false" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951884 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-139-136.ec2.internal" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951890 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951893 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951896 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951899 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951903 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951905 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951908 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951911 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951914 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951917 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951921 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:09:52.958378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951924 2569 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951928 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951931 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951935 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951937 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951940 2569 flags.go:64] FLAG: --lock-file="" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951943 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951946 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951949 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951955 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951958 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951961 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951965 2569 flags.go:64] FLAG: --logging-format="text" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951968 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951971 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951974 2569 flags.go:64] FLAG: --manifest-url="" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951977 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951981 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951985 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951989 2569 flags.go:64] FLAG: --max-pods="110" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951991 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951996 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.951999 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952002 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952005 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:09:52.958970 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952008 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952011 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952018 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952021 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952024 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952027 2569 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952030 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952036 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952039 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952043 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952046 2569 flags.go:64] FLAG: --port="10250" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952049 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952052 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef61de9875203d8d" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952055 2569 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952058 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952060 2569 flags.go:64] FLAG: --register-node="true" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952063 2569 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952067 2569 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952070 2569 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952072 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952075 2569 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952079 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952082 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952085 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952087 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:09:52.959601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952090 2569 flags.go:64] FLAG: --runonce="false" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952093 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952096 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952103 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952106 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952109 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952112 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952115 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952118 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952121 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952124 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952127 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952129 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952132 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952136 2569 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952139 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952147 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952150 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952153 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952157 2569 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952160 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952163 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952166 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952169 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952172 2569 flags.go:64] FLAG: --v="2" Jul 07 14:09:52.960203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952176 2569 flags.go:64] FLAG: --version="false" Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952180 2569 flags.go:64] FLAG: --vmodule="" Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952183 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952187 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952313 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952317 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952320 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952322 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952325 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952328 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952332 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952335 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952338 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952340 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952343 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952346 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952350 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952353 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952356 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952358 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:52.960884 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952361 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952364 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952368 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952372 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952376 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952379 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952382 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952385 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952388 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952391 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952393 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952396 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952398 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952401 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952403 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952406 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952408 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952411 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952413 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952415 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:52.961414 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952418 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952420 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952424 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952426 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952429 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952431 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952434 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952436 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952439 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952441 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952444 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952446 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952449 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952452 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952454 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952458 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952461 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952463 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952466 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952468 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:52.961893 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952471 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952473 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952476 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952478 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952481 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952483 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952486 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952488 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952491 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952493 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952496 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952498 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952501 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952503 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952507 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952509 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952512 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952514 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952517 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952519 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:52.962395 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952521 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952524 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952527 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952529 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952532 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952534 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952537 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952540 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952545 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952548 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952552 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952554 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952557 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952560 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952562 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952565 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952567 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952570 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952573 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952575 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:52.962886 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952578 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952580 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.952583 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.952591 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.959288 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.959303 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.959322 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.959329 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959386 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959391 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959395 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959398 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959401 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959404 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:52.963397 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959407 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959409 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959412 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959415 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959417 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959420 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959424 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959428 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959431 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959433 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959436 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959439 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959444 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959447 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959450 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959453 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959456 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959459 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959462 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:52.963756 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959465 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959467 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959470 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959473 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959477 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959480 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959483 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959486 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959490 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959493 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959496 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959499 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959503 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959506 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959509 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959512 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959515 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959517 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959520 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:52.964204 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959522 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959526 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959528 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959531 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959534 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959537 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959539 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959541 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959544 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959546 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959549 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959551 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959554 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959557 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959559 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959562 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959565 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959568 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959570 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959573 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:52.964724 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959576 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959579 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959581 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959584 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959586 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959589 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959591 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959594 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959596 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959599 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959602 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959604 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959607 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959609 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959613 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959616 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959618 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959621 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959624 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959627 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:52.965206 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959629 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959632 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959634 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959637 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959639 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959642 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959644 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959647 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959650 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959653 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959655 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959658 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959660 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959663 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959665 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:52.965693 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.959670 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959784 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959789 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959792 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959795 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959798 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959800 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959803 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959805 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959808 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959810 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959813 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959816 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959819 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959822 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959824 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959827 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959830 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959832 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959835 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:52.966051 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959837 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959840 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959842 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959846 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959849 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959852 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959855 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959858 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959860 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959863 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959866 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959868 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959871 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959873 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959876 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959878 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959881 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959883 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959887 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:52.966553 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959890 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959893 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959896 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959899 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959902 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959906 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959910 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959913 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959916 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959919 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959921 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959924 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959927 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959929 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959932 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959934 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959937 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959939 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959943 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:52.967012 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959945 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959948 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959951 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959953 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959955 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959958 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959960 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959963 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959966 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959968 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959971 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959973 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959975 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959978 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959980 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959983 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959985 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959988 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959990 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959993 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:52.967492 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959996 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.959998 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960001 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960003 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960006 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960008 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960011 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960013 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960016 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960018 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960021 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960024 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960026 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960028 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960031 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960034 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960036 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960038 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960041 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960043 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:52.967990 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960046 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:52.960048 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.960053 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.960153 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.962132 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.963550 2569 server.go:1019] "Starting client certificate rotation" Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.963644 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.963696 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:52.968489 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.966760 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:52.971874 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.971843 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:52.983606 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.983582 2569 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:09:52.985670 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.985651 2569 log.go:25] "Validated CRI v1 image API" Jul 07 14:09:52.987288 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.987268 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:09:52.990145 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.990122 2569 fs.go:135] Filesystem UUIDs: map[061416d5-45fb-4794-b9a1-f18eefcb3cdb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c5d5dd09-5e8f-490e-bb45-933ed6c0a23b:/dev/nvme0n1p4] Jul 07 14:09:52.990223 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.990141 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:09:52.992377 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.992348 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:52.994468 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.994352 2569 manager.go:216] Machine: {Timestamp:2026-07-07 14:09:52.993857011 +0000 UTC m=+0.348128729 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099006 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f00d2be0e73a924d3586ac4b6f2d9 SystemUUID:ec2f00d2-be0e-73a9-24d3-586ac4b6f2d9 BootID:53fb0307-6cf3-4f53-af19-8883c33fb291 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:9d:7d:2c:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:9d:7d:2c:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:d0:71:b2:1a:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:09:52.994468 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.994464 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:09:52.994609 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.994551 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:09:52.998274 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.998241 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:09:52.998419 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.998276 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:09:52.999101 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.999090 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:09:52.999138 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.999104 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:09:52.999138 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.999111 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:52.999792 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:52.999782 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:53.001088 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.001077 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:09:53.004374 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004362 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:53.004486 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004477 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:09:53.004527 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004506 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:09:53.004527 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004524 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:09:53.004610 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004542 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:09:53.004610 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004551 2569 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:09:53.004610 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004561 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:09:53.004896 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004886 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:53.004930 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.004903 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:53.008751 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.008733 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:09:53.010656 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.010641 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:09:53.010715 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.010673 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:09:53.011735 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011723 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011739 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011752 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011759 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011768 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011773 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011781 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011786 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011792 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:09:53.011801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011798 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:09:53.012135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011811 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:09:53.012135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011817 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:09:53.012135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011843 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:09:53.012135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.011849 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:09:53.015000 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.014985 2569 server.go:1268] "Started kubelet" Jul 07 14:09:53.015122 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.015075 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:09:53.015191 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.015144 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:09:53.015191 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.015146 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:09:53.015991 ip-10-0-139-136 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:09:53.021371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.021344 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:09:53.022411 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.022396 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:09:53.022746 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.022709 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:09:53.022853 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.022831 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9ss5" Jul 07 14:09:53.024035 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.024014 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:09:53.026692 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.026677 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:09:53.026796 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.026768 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-136.ec2.internal\" not found" Jul 07 14:09:53.026854 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.026679 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:53.027274 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027258 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:09:53.027384 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027278 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:09:53.027443 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027384 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:09:53.027443 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027392 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:09:53.027552 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027499 2569 factory.go:55] Registering systemd factory Jul 07 14:09:53.027552 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027514 2569 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:09:53.027646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027573 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:09:53.027744 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027730 2569 factory.go:153] Registering CRI-O factory Jul 07 14:09:53.027785 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027746 2569 factory.go:223] Registration of the crio container factory successfully Jul 07 14:09:53.027836 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027789 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:09:53.027836 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027812 2569 factory.go:103] Registering Raw factory Jul 07 14:09:53.027836 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.027823 2569 manager.go:1196] Started watching for new ooms in manager Jul 07 14:09:53.028358 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.028347 2569 manager.go:349] Starting recovery of all containers Jul 07 14:09:53.028486 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.027464 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-136.ec2.internal.18c00738cf39ea0a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-136.ec2.internal,UID:ip-10-0-139-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-136.ec2.internal,},FirstTimestamp:2026-07-07 14:09:53.014958602 +0000 UTC m=+0.369230321,LastTimestamp:2026-07-07 14:09:53.014958602 +0000 UTC m=+0.369230321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-136.ec2.internal,}" Jul 07 14:09:53.030307 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.030284 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9ss5" Jul 07 14:09:53.037462 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.037440 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:53.037569 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.037506 2569 manager.go:354] Recovery completed Jul 07 14:09:53.038217 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.038191 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:53.041540 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.041519 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:53.044006 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.042734 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:53.044763 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.044739 2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-136.ec2.internal\" not found" node="ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.045017 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045002 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:53.045075 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045031 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:53.045075 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045041 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:53.045576 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045559 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:09:53.045576 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045575 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:09:53.045687 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045581 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:53.045687 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.045592 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:53.046583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.046567 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:53.046639 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.046597 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:53.046639 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.046607 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:53.046639 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.046576 2569 policy_none.go:49] "None policy: Start" Jul 07 14:09:53.046725 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.046655 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:09:53.046725 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.046671 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:09:53.047703 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.047692 2569 policy_none.go:47] "Start" Jul 07 14:09:53.087804 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.087784 2569 manager.go:337] "Starting Device Plugin manager" Jul 07 14:09:53.087908 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.087841 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:09:53.087908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.087854 2569 server.go:87] "Starting device plugin registration server" Jul 07 14:09:53.088149 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.088136 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:09:53.088213 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.088152 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:09:53.088278 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.088260 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:09:53.088375 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.088355 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:09:53.088375 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.088372 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:09:53.088958 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.088933 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:09:53.089045 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.088986 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-136.ec2.internal\" not found" Jul 07 14:09:53.188466 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.188434 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:53.189561 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.189416 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:53.189561 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.189445 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:53.189561 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.189455 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:53.189561 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.189486 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.206985 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.206962 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.223542 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.223509 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:09:53.224774 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.224753 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:09:53.224876 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.224795 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:09:53.224876 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.224822 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:09:53.224876 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:53.224861 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:09:53.227933 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.227911 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:53.325775 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.325692 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal"] Jul 07 14:09:53.327644 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.327631 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.328627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.328613 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.329631 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.329615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f72cea69e8c4942c5863ad7b63bdf4e3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-136.ec2.internal\" (UID: \"f72cea69e8c4942c5863ad7b63bdf4e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.329678 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.329637 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d0eab9a5382b4685caf33d8130097b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal\" (UID: \"4d0eab9a5382b4685caf33d8130097b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.329678 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.329655 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d0eab9a5382b4685caf33d8130097b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal\" (UID: \"4d0eab9a5382b4685caf33d8130097b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.351106 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.351083 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.355461 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.355443 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.362140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.362122 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:53.368414 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.368396 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:53.430691 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.430664 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f72cea69e8c4942c5863ad7b63bdf4e3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-136.ec2.internal\" (UID: \"f72cea69e8c4942c5863ad7b63bdf4e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.430691 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.430690 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d0eab9a5382b4685caf33d8130097b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal\" (UID: \"4d0eab9a5382b4685caf33d8130097b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.430904 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.430706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d0eab9a5382b4685caf33d8130097b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal\" (UID: \"4d0eab9a5382b4685caf33d8130097b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.430904 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.430755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d0eab9a5382b4685caf33d8130097b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal\" (UID: \"4d0eab9a5382b4685caf33d8130097b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.430904 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.430774 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d0eab9a5382b4685caf33d8130097b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal\" (UID: \"4d0eab9a5382b4685caf33d8130097b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.430904 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.430778 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f72cea69e8c4942c5863ad7b63bdf4e3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-136.ec2.internal\" (UID: \"f72cea69e8c4942c5863ad7b63bdf4e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.665466 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.665368 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.671376 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.671359 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" Jul 07 14:09:53.962589 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.962557 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:09:53.963117 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.962706 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:53.963117 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.962751 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:53.963117 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:53.962759 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:54.005467 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.005435 2569 apiserver.go:52] "Watching apiserver" Jul 07 14:09:54.012184 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.012162 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:09:54.012524 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.012502 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4zpzq","openshift-multus/multus-additional-cni-plugins-jdxcs","openshift-multus/network-metrics-daemon-dmdzd","openshift-network-diagnostics/network-check-target-4tbs6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29","openshift-image-registry/node-ca-2glwb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal","openshift-multus/multus-rxzwh","openshift-network-operator/iptables-alerter-k66p7","openshift-ovn-kubernetes/ovnkube-node-wbqsv","kube-system/global-pull-secret-syncer-w2vcd","kube-system/konnectivity-agent-zwsh4","kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pjgbg"] Jul 07 14:09:54.013924 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.013911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.015088 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.015069 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.015691 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.015672 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlvgt\"" Jul 07 14:09:54.015876 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.015854 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.016671 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.016650 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.016768 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.016749 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.016872 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.016836 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:09:54.017577 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.017299 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.017577 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.017501 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:09:54.017794 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.017776 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:09:54.017902 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.017883 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mwtt6\"" Jul 07 14:09:54.017965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.017892 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.018256 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.018218 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:09:54.019717 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.019697 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:54.019860 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.019784 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:09:54.020878 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.020860 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.021907 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.021892 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.022457 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.022443 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:09:54.022641 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.022625 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.022864 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.022849 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qfzz8\"" Jul 07 14:09:54.023016 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.023001 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.023080 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.023069 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.023346 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.023332 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:09:54.023884 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.023866 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.023884 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.023877 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hpgwz\"" Jul 07 14:09:54.024005 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.023878 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.024133 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.024121 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.024759 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.024746 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tb2ss\"" Jul 07 14:09:54.024927 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.024914 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:09:54.025222 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.025210 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.026404 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.026384 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:09:54.026404 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.026401 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-28dsf\"" Jul 07 14:09:54.026558 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.026444 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.026558 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.026502 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:09:54.026981 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.026965 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:54.027078 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027045 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.027134 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027118 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.027245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027211 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.027434 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027418 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:09:54.027519 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027420 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.027614 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027597 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:09:54.027726 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027700 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:09:54.027806 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027704 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.027855 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027817 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:09:54.027992 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.027707 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vsfc9\"" Jul 07 14:09:54.028921 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.028906 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.029597 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.029577 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6vdq6\"" Jul 07 14:09:54.029597 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.029594 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:09:54.029746 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.029603 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:09:54.031176 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.031141 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:54.031270 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.031192 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gj5rl\"" Jul 07 14:09:54.031270 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.031195 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:54.032701 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-multus-certs\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.032751 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032708 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-tuned\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.032751 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032725 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.032751 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71473ade-a0c9-444c-b26f-b9c2708ea996-serviceca\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.032894 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-system-cni-dir\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.032894 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.032894 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-conf-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.032894 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032890 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysctl-conf\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.033099 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-log-socket\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033099 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-ovnkube-config\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033099 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032968 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks6fd\" (UniqueName: \"kubernetes.io/projected/abc642a7-6b3d-46af-ad43-b896e5231538-kube-api-access-ks6fd\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.033099 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.032997 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfqf\" (UniqueName: \"kubernetes.io/projected/491931ef-dad1-4f74-97b3-0580ff9abb99-kube-api-access-knfqf\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.033099 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033057 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-device-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.033099 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033081 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-etc-selinux\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033105 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-node-log\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033123 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-cni-bin\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033139 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdnm\" (UniqueName: \"kubernetes.io/projected/71473ade-a0c9-444c-b26f-b9c2708ea996-kube-api-access-vhdnm\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-kubelet\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-slash\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-systemd\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033204 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-cnibin\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-systemd\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ea2871f-9981-4ee2-b52a-79716692fff2-host-slash\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.033290 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033284 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-run-netns\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033304 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-socket-dir-parent\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033326 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-cni-multus\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033341 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrx8x\" (UniqueName: \"kubernetes.io/projected/992d75fb-eccf-4470-b749-4225c8ff52f6-kube-api-access-jrx8x\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033360 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-lib-modules\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b95f843-d7a4-48c6-ad9e-c8e104a50488-tmp-dir\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3da611b-0250-451d-8671-b5b47d36976d-ovn-node-metrics-cert\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-socket-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033425 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:04:53 +0000 UTC" deadline="2028-03-13 23:29:28.870021748 +0000 UTC" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033469 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14769h19m34.836555845s" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033510 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-kubelet\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-daemon-config\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-host\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033585 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b95f843-d7a4-48c6-ad9e-c8e104a50488-hosts-file\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033601 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c5c0759-27a4-482e-bfbd-2a5b06d655f6-konnectivity-ca\") pod \"konnectivity-agent-zwsh4\" (UID: \"9c5c0759-27a4-482e-bfbd-2a5b06d655f6\") " pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033638 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-os-release\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033659 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-kubelet-config\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.033694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033675 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033714 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-modprobe-d\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysctl-d\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71473ade-a0c9-444c-b26f-b9c2708ea996-host\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033785 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-cni-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033829 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-k8s-cni-cncf-io\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-hostroot\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033876 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7skvk\" (UniqueName: \"kubernetes.io/projected/8b95f843-d7a4-48c6-ad9e-c8e104a50488-kube-api-access-7skvk\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ea2871f-9981-4ee2-b52a-79716692fff2-iptables-alerter-script\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-ovn\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.033991 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c5c0759-27a4-482e-bfbd-2a5b06d655f6-agent-certs\") pod \"konnectivity-agent-zwsh4\" (UID: \"9c5c0759-27a4-482e-bfbd-2a5b06d655f6\") " pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034016 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-cni-bin\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034038 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysconfig\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e927d825-6dd7-4fdd-95ee-d3277866f026-tmp\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:54.034425 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034167 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-ovnkube-script-lib\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-var-lib-kubelet\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034219 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz7k5\" (UniqueName: \"kubernetes.io/projected/e927d825-6dd7-4fdd-95ee-d3277866f026-kube-api-access-wz7k5\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034271 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034292 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-registration-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-kubernetes\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-run\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-systemd-units\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9nz\" (UniqueName: \"kubernetes.io/projected/b3da611b-0250-451d-8671-b5b47d36976d-kube-api-access-2n9nz\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034426 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-os-release\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034483 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034499 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vn8m\" (UniqueName: \"kubernetes.io/projected/26532b3f-ccf1-454f-a964-0ba600f98bde-kube-api-access-5vn8m\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-etc-kubernetes\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-dbus\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034566 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-etc-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.034908 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034581 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-env-overrides\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034624 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-system-cni-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034637 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-netns\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-var-lib-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034671 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-sys-fs\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-sys\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034701 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6l4\" (UniqueName: \"kubernetes.io/projected/1ea2871f-9981-4ee2-b52a-79716692fff2-kube-api-access-pk6l4\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034714 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-cni-netd\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034740 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-cnibin\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034777 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.035371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.034802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/992d75fb-eccf-4470-b749-4225c8ff52f6-cni-binary-copy\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.046474 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.046458 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:54.070303 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.070267 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vhhf9" Jul 07 14:09:54.084291 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.084270 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vhhf9" Jul 07 14:09:54.129008 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.128978 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:09:54.135053 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.134992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-system-cni-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135053 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135030 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-netns\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135053 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135055 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-var-lib-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135332 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135076 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-sys-fs\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.135332 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135098 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-sys\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.135332 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135166 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-netns\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135332 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135257 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-var-lib-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135332 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135329 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-sys-fs\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135380 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-system-cni-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6l4\" (UniqueName: \"kubernetes.io/projected/1ea2871f-9981-4ee2-b52a-79716692fff2-kube-api-access-pk6l4\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-cni-netd\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-cnibin\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135505 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135522 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/992d75fb-eccf-4470-b749-4225c8ff52f6-cni-binary-copy\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135544 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-multus-certs\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-multus-certs\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135592 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-cni-netd\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135627 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-cnibin\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135628 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-tuned\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71473ade-a0c9-444c-b26f-b9c2708ea996-serviceca\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135708 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-system-cni-dir\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135760 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-conf-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135785 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysctl-conf\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135807 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-log-socket\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135829 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-ovnkube-config\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135854 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks6fd\" (UniqueName: \"kubernetes.io/projected/abc642a7-6b3d-46af-ad43-b896e5231538-kube-api-access-ks6fd\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135880 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfqf\" (UniqueName: \"kubernetes.io/projected/491931ef-dad1-4f74-97b3-0580ff9abb99-kube-api-access-knfqf\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-device-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135931 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-etc-selinux\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.135965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135934 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-conf-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-node-log\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.135981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-cni-bin\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136032 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-cni-bin\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdnm\" (UniqueName: \"kubernetes.io/projected/71473ade-a0c9-444c-b26f-b9c2708ea996-kube-api-access-vhdnm\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136329 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-system-cni-dir\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/992d75fb-eccf-4470-b749-4225c8ff52f6-cni-binary-copy\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136435 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-device-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136485 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71473ade-a0c9-444c-b26f-b9c2708ea996-serviceca\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136512 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136595 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-etc-selinux\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136626 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-ovnkube-config\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136655 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-node-log\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136694 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-log-socket\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136734 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-sys\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136752 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.136857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136768 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysctl-conf\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-kubelet\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-slash\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-systemd\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136975 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-kubelet\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.136999 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-slash\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137017 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-cnibin\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137045 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-systemd\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137050 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-systemd\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.137061 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ea2871f-9981-4ee2-b52a-79716692fff2-host-slash\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137098 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-systemd\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137104 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-run-netns\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.137143 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:54.637110182 +0000 UTC m=+1.991381887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137181 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-cnibin\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137142 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ea2871f-9981-4ee2-b52a-79716692fff2-host-slash\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.137731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137238 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-socket-dir-parent\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-cni-multus\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137286 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrx8x\" (UniqueName: \"kubernetes.io/projected/992d75fb-eccf-4470-b749-4225c8ff52f6-kube-api-access-jrx8x\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137220 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-run-netns\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-lib-modules\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b95f843-d7a4-48c6-ad9e-c8e104a50488-tmp-dir\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137423 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-socket-dir-parent\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137433 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3da611b-0250-451d-8671-b5b47d36976d-ovn-node-metrics-cert\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137464 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-cni-multus\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137503 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-socket-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137502 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-lib-modules\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-kubelet\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137623 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-socket-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137641 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-kubelet\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-daemon-config\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137729 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-host\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b95f843-d7a4-48c6-ad9e-c8e104a50488-hosts-file\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c5c0759-27a4-482e-bfbd-2a5b06d655f6-konnectivity-ca\") pod \"konnectivity-agent-zwsh4\" (UID: \"9c5c0759-27a4-482e-bfbd-2a5b06d655f6\") " pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.138619 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137817 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-os-release\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137841 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b95f843-d7a4-48c6-ad9e-c8e104a50488-tmp-dir\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137859 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-kubelet-config\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137884 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137909 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-modprobe-d\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137932 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysctl-d\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137938 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-os-release\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71473ade-a0c9-444c-b26f-b9c2708ea996-host\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.137996 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71473ade-a0c9-444c-b26f-b9c2708ea996-host\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.138016 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.138073 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:09:54.638056358 +0000 UTC m=+1.992328076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138080 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-modprobe-d\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138123 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-kubelet-config\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138153 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-cni-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138156 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysctl-d\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138176 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-daemon-config\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138178 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-k8s-cni-cncf-io\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138210 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-run-k8s-cni-cncf-io\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.139498 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138247 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-hostroot\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7skvk\" (UniqueName: \"kubernetes.io/projected/8b95f843-d7a4-48c6-ad9e-c8e104a50488-kube-api-access-7skvk\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138282 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-host\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138298 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-multus-cni-dir\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138300 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ea2871f-9981-4ee2-b52a-79716692fff2-iptables-alerter-script\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138330 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b95f843-d7a4-48c6-ad9e-c8e104a50488-hosts-file\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138338 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-ovn\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-hostroot\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138366 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138396 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c5c0759-27a4-482e-bfbd-2a5b06d655f6-agent-certs\") pod \"konnectivity-agent-zwsh4\" (UID: \"9c5c0759-27a4-482e-bfbd-2a5b06d655f6\") " pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-cni-bin\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138438 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c5c0759-27a4-482e-bfbd-2a5b06d655f6-konnectivity-ca\") pod \"konnectivity-agent-zwsh4\" (UID: \"9c5c0759-27a4-482e-bfbd-2a5b06d655f6\") " pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138480 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138493 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysconfig\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138442 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-sysconfig\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138543 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e927d825-6dd7-4fdd-95ee-d3277866f026-tmp\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138575 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-run-ovn\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.140431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138573 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-ovnkube-script-lib\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138639 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-var-lib-kubelet\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz7k5\" (UniqueName: \"kubernetes.io/projected/e927d825-6dd7-4fdd-95ee-d3277866f026-kube-api-access-wz7k5\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138717 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-registration-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-kubernetes\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-run\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138800 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ea2871f-9981-4ee2-b52a-79716692fff2-iptables-alerter-script\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-systemd-units\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138541 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-host-var-lib-cni-bin\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nz\" (UniqueName: \"kubernetes.io/projected/b3da611b-0250-451d-8671-b5b47d36976d-kube-api-access-2n9nz\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-os-release\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138875 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138915 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-var-lib-kubelet\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141140 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vn8m\" (UniqueName: \"kubernetes.io/projected/26532b3f-ccf1-454f-a964-0ba600f98bde-kube-api-access-5vn8m\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138961 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-etc-kubernetes\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138985 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-dbus\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.138990 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-os-release\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-etc-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-env-overrides\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-ovnkube-script-lib\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139492 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-dbus\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139551 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-run\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139598 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abc642a7-6b3d-46af-ad43-b896e5231538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139603 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-kubernetes\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139137 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abc642a7-6b3d-46af-ad43-b896e5231538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139096 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26532b3f-ccf1-454f-a964-0ba600f98bde-registration-dir\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139668 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139712 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-etc-openvswitch\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139762 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/992d75fb-eccf-4470-b749-4225c8ff52f6-etc-kubernetes\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.141982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139803 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3da611b-0250-451d-8671-b5b47d36976d-systemd-units\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.142539 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.139904 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3da611b-0250-451d-8671-b5b47d36976d-env-overrides\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.142539 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.140736 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e927d825-6dd7-4fdd-95ee-d3277866f026-etc-tuned\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.142539 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.141240 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e927d825-6dd7-4fdd-95ee-d3277866f026-tmp\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.142539 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.141797 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3da611b-0250-451d-8671-b5b47d36976d-ovn-node-metrics-cert\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.142539 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.142524 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c5c0759-27a4-482e-bfbd-2a5b06d655f6-agent-certs\") pod \"konnectivity-agent-zwsh4\" (UID: \"9c5c0759-27a4-482e-bfbd-2a5b06d655f6\") " pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.144020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.143753 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:54.144020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.143775 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:54.144020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.143796 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:54.144020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.143855 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:54.643836174 +0000 UTC m=+1.998107895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:54.144020 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.143774 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdnm\" (UniqueName: \"kubernetes.io/projected/71473ade-a0c9-444c-b26f-b9c2708ea996-kube-api-access-vhdnm\") pod \"node-ca-2glwb\" (UID: \"71473ade-a0c9-444c-b26f-b9c2708ea996\") " pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.144020 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.143948 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6l4\" (UniqueName: \"kubernetes.io/projected/1ea2871f-9981-4ee2-b52a-79716692fff2-kube-api-access-pk6l4\") pod \"iptables-alerter-k66p7\" (UID: \"1ea2871f-9981-4ee2-b52a-79716692fff2\") " pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.145241 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.145205 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks6fd\" (UniqueName: \"kubernetes.io/projected/abc642a7-6b3d-46af-ad43-b896e5231538-kube-api-access-ks6fd\") pod \"multus-additional-cni-plugins-jdxcs\" (UID: \"abc642a7-6b3d-46af-ad43-b896e5231538\") " pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.145540 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.145523 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfqf\" (UniqueName: \"kubernetes.io/projected/491931ef-dad1-4f74-97b3-0580ff9abb99-kube-api-access-knfqf\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.145825 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.145811 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrx8x\" (UniqueName: \"kubernetes.io/projected/992d75fb-eccf-4470-b749-4225c8ff52f6-kube-api-access-jrx8x\") pod \"multus-rxzwh\" (UID: \"992d75fb-eccf-4470-b749-4225c8ff52f6\") " pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.155789 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.155734 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz7k5\" (UniqueName: \"kubernetes.io/projected/e927d825-6dd7-4fdd-95ee-d3277866f026-kube-api-access-wz7k5\") pod \"tuned-pjgbg\" (UID: \"e927d825-6dd7-4fdd-95ee-d3277866f026\") " pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.157997 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.157968 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7skvk\" (UniqueName: \"kubernetes.io/projected/8b95f843-d7a4-48c6-ad9e-c8e104a50488-kube-api-access-7skvk\") pod \"node-resolver-4zpzq\" (UID: \"8b95f843-d7a4-48c6-ad9e-c8e104a50488\") " pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.158598 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.158576 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9nz\" (UniqueName: \"kubernetes.io/projected/b3da611b-0250-451d-8671-b5b47d36976d-kube-api-access-2n9nz\") pod \"ovnkube-node-wbqsv\" (UID: \"b3da611b-0250-451d-8671-b5b47d36976d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.159631 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.159612 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vn8m\" (UniqueName: \"kubernetes.io/projected/26532b3f-ccf1-454f-a964-0ba600f98bde-kube-api-access-5vn8m\") pod \"aws-ebs-csi-driver-node-dvb29\" (UID: \"26532b3f-ccf1-454f-a964-0ba600f98bde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.169982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.169963 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:09:54.175840 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.175659 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" Jul 07 14:09:54.214625 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.214567 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0eab9a5382b4685caf33d8130097b3.slice/crio-e028506e30fe7261e7d48cba94c814e06e9430a3c1fd1b356007ef1e89af1597 WatchSource:0}: Error finding container e028506e30fe7261e7d48cba94c814e06e9430a3c1fd1b356007ef1e89af1597: Status 404 returned error can't find the container with id e028506e30fe7261e7d48cba94c814e06e9430a3c1fd1b356007ef1e89af1597 Jul 07 14:09:54.214784 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.214766 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72cea69e8c4942c5863ad7b63bdf4e3.slice/crio-f7eafc929345b029b3205b8a4ce00e73ee3db96cc528bd5553da0d2ed00a78a8 WatchSource:0}: Error finding container f7eafc929345b029b3205b8a4ce00e73ee3db96cc528bd5553da0d2ed00a78a8: Status 404 returned error can't find the container with id f7eafc929345b029b3205b8a4ce00e73ee3db96cc528bd5553da0d2ed00a78a8 Jul 07 14:09:54.219995 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.219977 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:09:54.227657 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.227607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" event={"ID":"f72cea69e8c4942c5863ad7b63bdf4e3","Type":"ContainerStarted","Data":"f7eafc929345b029b3205b8a4ce00e73ee3db96cc528bd5553da0d2ed00a78a8"} Jul 07 14:09:54.228587 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.228563 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" event={"ID":"4d0eab9a5382b4685caf33d8130097b3","Type":"ContainerStarted","Data":"e028506e30fe7261e7d48cba94c814e06e9430a3c1fd1b356007ef1e89af1597"} Jul 07 14:09:54.341918 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.341892 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4zpzq" Jul 07 14:09:54.348337 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.348315 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" Jul 07 14:09:54.349638 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.349617 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b95f843_d7a4_48c6_ad9e_c8e104a50488.slice/crio-37e49d3b111e20fcb980c925294f399cb6787a2e799c2fd9a12e9df0f57143f2 WatchSource:0}: Error finding container 37e49d3b111e20fcb980c925294f399cb6787a2e799c2fd9a12e9df0f57143f2: Status 404 returned error can't find the container with id 37e49d3b111e20fcb980c925294f399cb6787a2e799c2fd9a12e9df0f57143f2 Jul 07 14:09:54.355752 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.355732 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc642a7_6b3d_46af_ad43_b896e5231538.slice/crio-3ccb589e56d301d48ce655c1ba60f4df52e0d28b703929ca8167fbf82bb316b3 WatchSource:0}: Error finding container 3ccb589e56d301d48ce655c1ba60f4df52e0d28b703929ca8167fbf82bb316b3: Status 404 returned error can't find the container with id 3ccb589e56d301d48ce655c1ba60f4df52e0d28b703929ca8167fbf82bb316b3 Jul 07 14:09:54.372656 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.372633 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" Jul 07 14:09:54.380018 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.379988 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26532b3f_ccf1_454f_a964_0ba600f98bde.slice/crio-43ca690dc24ba5e577079ab192003036a3c1e4ac08d8ce82130ced1acc552d71 WatchSource:0}: Error finding container 43ca690dc24ba5e577079ab192003036a3c1e4ac08d8ce82130ced1acc552d71: Status 404 returned error can't find the container with id 43ca690dc24ba5e577079ab192003036a3c1e4ac08d8ce82130ced1acc552d71 Jul 07 14:09:54.384072 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.384055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2glwb" Jul 07 14:09:54.391599 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.391573 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71473ade_a0c9_444c_b26f_b9c2708ea996.slice/crio-e43e7ba6b81a447f48801afdde99fdc6b6b6983485f518eb55e4ec1aeaff5558 WatchSource:0}: Error finding container e43e7ba6b81a447f48801afdde99fdc6b6b6983485f518eb55e4ec1aeaff5558: Status 404 returned error can't find the container with id e43e7ba6b81a447f48801afdde99fdc6b6b6983485f518eb55e4ec1aeaff5558 Jul 07 14:09:54.397599 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.397580 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rxzwh" Jul 07 14:09:54.403576 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.403560 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k66p7" Jul 07 14:09:54.404741 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.404713 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992d75fb_eccf_4470_b749_4225c8ff52f6.slice/crio-0f5b0fb838cc2f4a3a1e4123fe1c66b6bb2da8700d55301e0a3102a8351d85ef WatchSource:0}: Error finding container 0f5b0fb838cc2f4a3a1e4123fe1c66b6bb2da8700d55301e0a3102a8351d85ef: Status 404 returned error can't find the container with id 0f5b0fb838cc2f4a3a1e4123fe1c66b6bb2da8700d55301e0a3102a8351d85ef Jul 07 14:09:54.411478 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.411454 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea2871f_9981_4ee2_b52a_79716692fff2.slice/crio-e924301841437365d906203fd296a34140db194c0dcfd607129220f89d0e5eb8 WatchSource:0}: Error finding container e924301841437365d906203fd296a34140db194c0dcfd607129220f89d0e5eb8: Status 404 returned error can't find the container with id e924301841437365d906203fd296a34140db194c0dcfd607129220f89d0e5eb8 Jul 07 14:09:54.440605 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.440572 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:09:54.448517 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.448487 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3da611b_0250_451d_8671_b5b47d36976d.slice/crio-787be9ab0ebba56bb9231794764b17ba1bf32960dc05cfae1498f5021de80b4e WatchSource:0}: Error finding container 787be9ab0ebba56bb9231794764b17ba1bf32960dc05cfae1498f5021de80b4e: Status 404 returned error can't find the container with id 787be9ab0ebba56bb9231794764b17ba1bf32960dc05cfae1498f5021de80b4e Jul 07 14:09:54.483306 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.483277 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5c0759_27a4_482e_bfbd_2a5b06d655f6.slice/crio-8c6e8e706d61772734723dd6180ce5185a62805a7adca7ab31ad44d45b4fa8f5 WatchSource:0}: Error finding container 8c6e8e706d61772734723dd6180ce5185a62805a7adca7ab31ad44d45b4fa8f5: Status 404 returned error can't find the container with id 8c6e8e706d61772734723dd6180ce5185a62805a7adca7ab31ad44d45b4fa8f5 Jul 07 14:09:54.508912 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:09:54.508885 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode927d825_6dd7_4fdd_95ee_d3277866f026.slice/crio-838683e630da50d5e68d1c13734d84efd19dbfac0fcce9eb44469730774a6515 WatchSource:0}: Error finding container 838683e630da50d5e68d1c13734d84efd19dbfac0fcce9eb44469730774a6515: Status 404 returned error can't find the container with id 838683e630da50d5e68d1c13734d84efd19dbfac0fcce9eb44469730774a6515 Jul 07 14:09:54.642905 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.642865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:54.643100 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.642917 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:54.643100 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.643019 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:54.643100 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.643061 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:54.643100 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.643085 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:55.64306916 +0000 UTC m=+2.997340870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:54.643278 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.643112 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:09:55.643096072 +0000 UTC m=+2.997367776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:54.743844 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:54.743756 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:54.744029 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.743933 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:54.744029 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.743950 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:54.744029 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.743963 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:54.744029 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:54.744022 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:55.744001829 +0000 UTC m=+3.098273540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:55.087119 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.086926 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:54 +0000 UTC" deadline="2027-12-26 20:27:40.187182306 +0000 UTC" Jul 07 14:09:55.087119 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.086991 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12894h17m45.100196259s" Jul 07 14:09:55.169799 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.169604 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:55.226894 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.226345 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:55.226894 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.226493 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:09:55.227442 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.227222 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:55.227442 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.227356 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:09:55.265183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.265141 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zwsh4" event={"ID":"9c5c0759-27a4-482e-bfbd-2a5b06d655f6","Type":"ContainerStarted","Data":"8c6e8e706d61772734723dd6180ce5185a62805a7adca7ab31ad44d45b4fa8f5"} Jul 07 14:09:55.270910 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.270878 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"787be9ab0ebba56bb9231794764b17ba1bf32960dc05cfae1498f5021de80b4e"} Jul 07 14:09:55.281629 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.281569 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k66p7" event={"ID":"1ea2871f-9981-4ee2-b52a-79716692fff2","Type":"ContainerStarted","Data":"e924301841437365d906203fd296a34140db194c0dcfd607129220f89d0e5eb8"} Jul 07 14:09:55.288959 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.288736 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:55.290694 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.290669 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:55.307690 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.307649 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rxzwh" event={"ID":"992d75fb-eccf-4470-b749-4225c8ff52f6","Type":"ContainerStarted","Data":"0f5b0fb838cc2f4a3a1e4123fe1c66b6bb2da8700d55301e0a3102a8351d85ef"} Jul 07 14:09:55.327544 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.327502 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4zpzq" event={"ID":"8b95f843-d7a4-48c6-ad9e-c8e104a50488","Type":"ContainerStarted","Data":"37e49d3b111e20fcb980c925294f399cb6787a2e799c2fd9a12e9df0f57143f2"} Jul 07 14:09:55.347022 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.346929 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" event={"ID":"e927d825-6dd7-4fdd-95ee-d3277866f026","Type":"ContainerStarted","Data":"838683e630da50d5e68d1c13734d84efd19dbfac0fcce9eb44469730774a6515"} Jul 07 14:09:55.363504 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.363465 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2glwb" event={"ID":"71473ade-a0c9-444c-b26f-b9c2708ea996","Type":"ContainerStarted","Data":"e43e7ba6b81a447f48801afdde99fdc6b6b6983485f518eb55e4ec1aeaff5558"} Jul 07 14:09:55.389962 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.389926 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" event={"ID":"26532b3f-ccf1-454f-a964-0ba600f98bde","Type":"ContainerStarted","Data":"43ca690dc24ba5e577079ab192003036a3c1e4ac08d8ce82130ced1acc552d71"} Jul 07 14:09:55.433323 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.433284 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerStarted","Data":"3ccb589e56d301d48ce655c1ba60f4df52e0d28b703929ca8167fbf82bb316b3"} Jul 07 14:09:55.651949 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.651671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:55.651949 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.651731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:55.651949 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.651901 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:55.652529 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.651964 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.651946213 +0000 UTC m=+5.006217921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:55.652529 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.652375 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:55.652529 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.652423 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.652407801 +0000 UTC m=+5.006679507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:55.752182 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:55.752143 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:55.752387 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.752351 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:55.752387 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.752370 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:55.752387 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.752385 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:55.752542 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:55.752444 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.752426277 +0000 UTC m=+5.106698021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:56.087324 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:56.087250 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:54 +0000 UTC" deadline="2028-02-14 03:23:17.418969715 +0000 UTC" Jul 07 14:09:56.087324 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:56.087290 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14077h13m21.331684137s" Jul 07 14:09:56.225612 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:56.225576 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:56.225788 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:56.225711 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:09:57.227724 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:57.227687 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:57.228166 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.227829 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:09:57.228265 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:57.228223 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:57.228377 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.228354 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:09:57.668009 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:57.667247 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:57.668009 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:57.667309 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:57.668009 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.667463 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:57.668009 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.667524 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:10:01.667507007 +0000 UTC m=+9.021778718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:57.668009 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.667918 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:57.668009 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.667967 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:01.66795405 +0000 UTC m=+9.022225761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:57.767841 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:57.767799 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:57.768020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.767980 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:57.768020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.768003 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:57.768020 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.768018 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:57.768193 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:57.768079 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:01.768060013 +0000 UTC m=+9.122331720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:58.225928 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:58.225894 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:09:58.226137 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:58.226039 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:09:59.225544 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:59.225511 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:09:59.226009 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:59.225653 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:09:59.226085 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:09:59.226064 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:09:59.226181 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:09:59.226156 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:00.225070 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:00.225036 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:00.225285 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:00.225175 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:01.225761 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:01.225553 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:01.226214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:01.225553 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:01.226214 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.225857 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:01.226214 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.225966 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:01.704028 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:01.703982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:01.704243 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:01.704057 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:01.704243 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.704158 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:01.704243 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.704217 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:01.704412 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.704247 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:09.704208707 +0000 UTC m=+17.058480414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:01.704412 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.704288 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:10:09.704269485 +0000 UTC m=+17.058541195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:01.804587 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:01.804537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:01.804847 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.804716 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:01.804847 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.804740 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:01.804847 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.804754 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:01.804847 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:01.804817 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:09.804797929 +0000 UTC m=+17.159069639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:02.225860 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:02.225824 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:02.226289 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:02.225979 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:03.227903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:03.227823 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:03.228357 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:03.227944 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:03.228357 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:03.228004 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:03.228357 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:03.228121 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:04.225353 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:04.225317 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:04.225527 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:04.225445 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:05.226241 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:05.225976 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:05.226241 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:05.226013 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:05.226241 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:05.226135 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:05.226824 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:05.226266 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:06.225709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:06.225669 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:06.225889 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:06.225813 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:07.225168 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:07.225127 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:07.225661 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:07.225127 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:07.225661 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:07.225306 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:07.225661 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:07.225352 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:08.226080 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:08.226039 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:08.226581 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:08.226177 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:09.225522 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:09.225480 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:09.225702 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:09.225634 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:09.225702 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.225634 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:09.225803 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.225726 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:09.765019 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:09.764967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:09.765557 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:09.765066 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:09.765557 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.765145 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:09.765557 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.765170 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:09.765557 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.765219 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.765204724 +0000 UTC m=+33.119476429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:09.765557 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.765255 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.765244737 +0000 UTC m=+33.119516441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:09.866246 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:09.866191 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:09.866423 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.866382 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:09.866423 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.866419 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:09.866527 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.866435 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:09.866527 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:09.866505 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.866483814 +0000 UTC m=+33.220755522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:10.225858 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:10.225822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:10.226058 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:10.225942 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:11.225276 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:11.225222 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:11.225714 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:11.225249 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:11.225714 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:11.225391 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:11.225714 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:11.225438 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:12.225496 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:12.225455 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:12.225973 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:12.225587 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:13.226623 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:13.226586 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:13.227082 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:13.226715 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:13.227082 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:13.226770 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:13.227082 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:13.226917 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:14.225473 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:14.225437 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:14.225628 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:14.225541 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:14.474532 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:14.474501 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" event={"ID":"f72cea69e8c4942c5863ad7b63bdf4e3","Type":"ContainerStarted","Data":"3eb5a260518ffbce9c25b3e71ed44967c36f32d5d10fc2adacb16d122a7d5a05"} Jul 07 14:10:14.476647 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:14.476623 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" event={"ID":"e927d825-6dd7-4fdd-95ee-d3277866f026","Type":"ContainerStarted","Data":"d1ff91f87a36ac865a24c5d31d7763eb3b10cfc503d5646ac69b52c0f2826cfc"} Jul 07 14:10:14.489158 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:14.489102 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-136.ec2.internal" podStartSLOduration=21.489083996 podStartE2EDuration="21.489083996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:14.488514342 +0000 UTC m=+21.842786070" watchObservedRunningTime="2026-07-07 14:10:14.489083996 +0000 UTC m=+21.843355724" Jul 07 14:10:14.508261 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:14.507327 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pjgbg" podStartSLOduration=1.750750794 podStartE2EDuration="21.507303388s" totalImagesPullingTime="19.756552594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:14.506126164 +0000 UTC m=+21.860397892" watchObservedRunningTime="2026-07-07 14:10:14.507303388 +0000 UTC m=+21.861575125" Jul 07 14:10:15.225680 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.225507 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:15.225833 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.225579 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:15.225833 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:15.225773 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:15.225953 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:15.225845 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:15.480557 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.480293 2569 generic.go:356] "Generic (PLEG): container finished" podID="4d0eab9a5382b4685caf33d8130097b3" containerID="a876a18f582ce00777417dd4515217b53d2c71fb9180334222df23547f7bbc91" exitCode=0 Jul 07 14:10:15.481331 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.480375 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" event={"ID":"4d0eab9a5382b4685caf33d8130097b3","Type":"ContainerDied","Data":"a876a18f582ce00777417dd4515217b53d2c71fb9180334222df23547f7bbc91"} Jul 07 14:10:15.482100 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.482075 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zwsh4" event={"ID":"9c5c0759-27a4-482e-bfbd-2a5b06d655f6","Type":"ContainerStarted","Data":"932401ae6db5d389937c58f6bf26b93649f7a9881dea1e75eb7c41e162eff766"} Jul 07 14:10:15.484945 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.484926 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:10:15.485350 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485327 2569 generic.go:356] "Generic (PLEG): container finished" podID="b3da611b-0250-451d-8671-b5b47d36976d" containerID="c4b8131e6277be16fa44f4f0f0168bad4236fddeb3719b2e841dac3af55827d3" exitCode=1 Jul 07 14:10:15.485434 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"d0dcfe868c973ccc8c403bab4d211731021cc968d2963f31548259a76669de4f"} Jul 07 14:10:15.485492 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485462 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"48a2b3593664900d21e0fff71489b408c55b3b97a57a3ea137f52a1a7adf0c3b"} Jul 07 14:10:15.485540 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485500 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"6c8cde65381e7456f78c3d07ae852b433fc61cf37ce109c247f46c4a0875cee9"} Jul 07 14:10:15.485582 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485540 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"c81e6c5ba140f9feb4598eff5ce969dd3aaa6917d7e80836d4242258be58b0a4"} Jul 07 14:10:15.485582 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485573 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerDied","Data":"c4b8131e6277be16fa44f4f0f0168bad4236fddeb3719b2e841dac3af55827d3"} Jul 07 14:10:15.485670 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.485612 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"552a06d84f260bc33bc04c6b6a0a4a3867bf0cc4afeee20f0ccaa2ef7e2c884e"} Jul 07 14:10:15.486849 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.486825 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rxzwh" event={"ID":"992d75fb-eccf-4470-b749-4225c8ff52f6","Type":"ContainerStarted","Data":"3620bf232c857f4839bc598a11a5b9778471bb23b97fa61af10ef3fc92e6f43c"} Jul 07 14:10:15.488142 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.488122 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4zpzq" event={"ID":"8b95f843-d7a4-48c6-ad9e-c8e104a50488","Type":"ContainerStarted","Data":"0ca7ddec0c87b0e4dcc41619b39ec76e52f49d0ba78ccf6214bcad876b639b5a"} Jul 07 14:10:15.489397 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.489378 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2glwb" event={"ID":"71473ade-a0c9-444c-b26f-b9c2708ea996","Type":"ContainerStarted","Data":"94b491e75cccb4854299cfd34f65779c736b2b89145733ae1c3b66898e1c8e50"} Jul 07 14:10:15.490661 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.490642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" event={"ID":"26532b3f-ccf1-454f-a964-0ba600f98bde","Type":"ContainerStarted","Data":"95bacd474f42ac7625e81ea8e18cbb0939772c19fc1add77e5c6524e157d86e1"} Jul 07 14:10:15.492010 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.491989 2569 generic.go:356] "Generic (PLEG): container finished" podID="abc642a7-6b3d-46af-ad43-b896e5231538" containerID="d3e56cd90d5578302d6299ae70c8eaebb87ada3085fc7705959192a5a57f6bf3" exitCode=0 Jul 07 14:10:15.492071 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.492028 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerDied","Data":"d3e56cd90d5578302d6299ae70c8eaebb87ada3085fc7705959192a5a57f6bf3"} Jul 07 14:10:15.510968 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.510917 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4zpzq" podStartSLOduration=2.595449097 podStartE2EDuration="22.510903551s" totalImagesPullingTime="19.915454454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:15.510408981 +0000 UTC m=+22.864680707" watchObservedRunningTime="2026-07-07 14:10:15.510903551 +0000 UTC m=+22.865175278" Jul 07 14:10:15.544547 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.544493 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zwsh4" podStartSLOduration=2.762784335 podStartE2EDuration="22.544477754s" totalImagesPullingTime="19.781693419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:15.523653498 +0000 UTC m=+22.877925224" watchObservedRunningTime="2026-07-07 14:10:15.544477754 +0000 UTC m=+22.898749480" Jul 07 14:10:15.559779 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.559734 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2glwb" podStartSLOduration=2.686052907 podStartE2EDuration="22.55971938s" totalImagesPullingTime="19.873666473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:15.559466396 +0000 UTC m=+22.913738141" watchObservedRunningTime="2026-07-07 14:10:15.55971938 +0000 UTC m=+22.913991107" Jul 07 14:10:15.583083 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:15.582809 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rxzwh" podStartSLOduration=2.685167156 podStartE2EDuration="22.582789249s" totalImagesPullingTime="19.897622093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:15.581860862 +0000 UTC m=+22.936132592" watchObservedRunningTime="2026-07-07 14:10:15.582789249 +0000 UTC m=+22.937060979" Jul 07 14:10:16.225500 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.225467 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:16.225706 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:16.225565 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:16.432152 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.432112 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:10:16.496277 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.496180 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k66p7" event={"ID":"1ea2871f-9981-4ee2-b52a-79716692fff2","Type":"ContainerStarted","Data":"005585844c42eb8750a9990bb2fdbaa17c8f07f87f7474f648fa6efe60cf8803"} Jul 07 14:10:16.498278 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.498251 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" event={"ID":"26532b3f-ccf1-454f-a964-0ba600f98bde","Type":"ContainerStarted","Data":"5a974f460b90f0e8d2cb4f2b4832c0c6a30963b12f1f3722013bb322b5f716b7"} Jul 07 14:10:16.500325 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.500267 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" event={"ID":"4d0eab9a5382b4685caf33d8130097b3","Type":"ContainerStarted","Data":"72eddbb8b2fad9e145b80dc050ae40df7ab9005fb059db545d82feae9cdd4832"} Jul 07 14:10:16.512261 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.512194 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k66p7" podStartSLOduration=3.6586455620000002 podStartE2EDuration="23.512173831s" totalImagesPullingTime="19.853528269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:16.512139022 +0000 UTC m=+23.866410752" watchObservedRunningTime="2026-07-07 14:10:16.512173831 +0000 UTC m=+23.866445558" Jul 07 14:10:16.527977 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:16.527929 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-136.ec2.internal" podStartSLOduration=23.527914413 podStartE2EDuration="23.527914413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:16.527850456 +0000 UTC m=+23.882122184" watchObservedRunningTime="2026-07-07 14:10:16.527914413 +0000 UTC m=+23.882186139" Jul 07 14:10:17.036735 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.036699 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:10:17.037333 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.037311 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:10:17.103340 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.103219 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:10:16.432139064Z","UUID":"ea92b4cb-ca7f-45b8-8a68-167d642b5c9f","Handler":null,"Name":"","Endpoint":""} Jul 07 14:10:17.104962 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.104940 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:10:17.105096 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.104981 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:10:17.225814 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.225776 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:17.225814 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.225811 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:17.226141 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:17.225928 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:17.226317 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:17.226285 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:17.502852 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.502754 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:10:17.503465 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:17.503365 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zwsh4" Jul 07 14:10:18.225289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:18.225256 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:18.225474 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:18.225362 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:18.508408 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:18.508333 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:10:18.508835 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:18.508781 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"58a59ad7beb20e485ade8ac3477d1974333bc5741f6959639636c6257bbf5452"} Jul 07 14:10:18.511217 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:18.511180 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" event={"ID":"26532b3f-ccf1-454f-a964-0ba600f98bde","Type":"ContainerStarted","Data":"c52427039b6074d2b9ae44f9421aee4acec60e4b043154f6886b0bdcaf58d40b"} Jul 07 14:10:18.530325 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:18.530273 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvb29" podStartSLOduration=3.190268657 podStartE2EDuration="25.530255811s" totalImagesPullingTime="22.339987154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:18.52959465 +0000 UTC m=+25.883866394" watchObservedRunningTime="2026-07-07 14:10:18.530255811 +0000 UTC m=+25.884527799" Jul 07 14:10:19.226157 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:19.226117 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:19.226157 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:19.226160 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:19.226422 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:19.226269 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:19.226422 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:19.226403 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:20.225522 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.225337 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:20.225911 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:20.225613 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:20.519938 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.519857 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:10:20.520311 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.520268 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"f800208a7c0020851ac9fb5c203960aefd519c7859cb588ea0e85a18c8f5a105"} Jul 07 14:10:20.520514 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.520497 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:10:20.520580 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.520569 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:10:20.520709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.520685 2569 scope.go:117] "RemoveContainer" containerID="c4b8131e6277be16fa44f4f0f0168bad4236fddeb3719b2e841dac3af55827d3" Jul 07 14:10:20.522173 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.522153 2569 generic.go:356] "Generic (PLEG): container finished" podID="abc642a7-6b3d-46af-ad43-b896e5231538" containerID="51e2aaf66068e379ed9b1fbba981ca9260eb1649820502367e04a4902c9bc05e" exitCode=0 Jul 07 14:10:20.522284 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.522179 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerDied","Data":"51e2aaf66068e379ed9b1fbba981ca9260eb1649820502367e04a4902c9bc05e"} Jul 07 14:10:20.536871 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:20.536844 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:10:21.225856 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.225822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:21.226692 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.225822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:21.226692 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:21.225965 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:21.226692 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:21.226029 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:21.527723 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.527643 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:10:21.528082 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.528057 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" event={"ID":"b3da611b-0250-451d-8671-b5b47d36976d","Type":"ContainerStarted","Data":"440df409aa2264e0d2ebf057c3c3c22ff8cf4fc65f8433f981d4f6e36edf35a2"} Jul 07 14:10:21.528255 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.528219 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:10:21.544852 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.544821 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:10:21.559044 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:21.558991 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" podStartSLOduration=8.305850242 podStartE2EDuration="28.558975694s" totalImagesPullingTime="20.253125452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:21.557966862 +0000 UTC m=+28.912238588" watchObservedRunningTime="2026-07-07 14:10:21.558975694 +0000 UTC m=+28.913247421" Jul 07 14:10:22.225867 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.225831 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:22.226297 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:22.225962 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:22.366792 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.366762 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4tbs6"] Jul 07 14:10:22.366940 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.366889 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:22.366999 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:22.366980 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:22.369573 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.369545 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w2vcd"] Jul 07 14:10:22.370124 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.370105 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmdzd"] Jul 07 14:10:22.370215 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.370204 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:22.370339 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:22.370307 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:22.532521 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.532488 2569 generic.go:356] "Generic (PLEG): container finished" podID="abc642a7-6b3d-46af-ad43-b896e5231538" containerID="0cd2fb0a9aa0333f9f6748120ea1f174a12185539f348f3b287bfd7c06cbef1f" exitCode=0 Jul 07 14:10:22.532709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.532559 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:22.532709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:22.532575 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerDied","Data":"0cd2fb0a9aa0333f9f6748120ea1f174a12185539f348f3b287bfd7c06cbef1f"} Jul 07 14:10:22.532808 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:22.532754 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:24.226001 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:24.225964 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:24.226001 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:24.225994 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:24.226540 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:24.225970 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:24.226540 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:24.226092 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:24.226540 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:24.226145 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:24.226540 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:24.226301 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:24.540337 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:24.540300 2569 generic.go:356] "Generic (PLEG): container finished" podID="abc642a7-6b3d-46af-ad43-b896e5231538" containerID="2d58c726bf882c6f27026b3420af4bd0c15d7b5dfcd77fbacf63978cbf039940" exitCode=0 Jul 07 14:10:24.540526 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:24.540357 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerDied","Data":"2d58c726bf882c6f27026b3420af4bd0c15d7b5dfcd77fbacf63978cbf039940"} Jul 07 14:10:25.774893 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:25.774671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:25.775384 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:25.774928 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:25.775384 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.774812 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:25.775384 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.775017 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:25.775384 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.775050 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs podName:491931ef-dad1-4f74-97b3-0580ff9abb99 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:57.775020243 +0000 UTC m=+65.129291949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs") pod "network-metrics-daemon-dmdzd" (UID: "491931ef-dad1-4f74-97b3-0580ff9abb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:25.775384 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.775073 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret podName:e574e5d9-ef9f-433d-81e0-5d1c7f2976da nodeName:}" failed. No retries permitted until 2026-07-07 14:10:57.775063644 +0000 UTC m=+65.129335356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret") pod "global-pull-secret-syncer-w2vcd" (UID: "e574e5d9-ef9f-433d-81e0-5d1c7f2976da") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:25.876112 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:25.876081 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:25.876316 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.876221 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:25.876316 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.876258 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:25.876316 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.876272 2569 projected.go:196] Error preparing data for projected volume kube-api-access-f6c7p for pod openshift-network-diagnostics/network-check-target-4tbs6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:25.876462 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:25.876330 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p podName:e22fabac-8d10-476c-a66c-2d03bbd8ce19 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:57.876313816 +0000 UTC m=+65.230585527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6c7p" (UniqueName: "kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p") pod "network-check-target-4tbs6" (UID: "e22fabac-8d10-476c-a66c-2d03bbd8ce19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:26.225212 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:26.225169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:26.225414 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:26.225169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:26.225414 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:26.225335 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:26.225414 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:26.225166 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:26.225414 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:26.225401 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:26.225617 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:26.225478 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:28.225693 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.225654 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:28.226130 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.225701 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:28.226130 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.225701 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:28.226130 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:28.225761 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tbs6" podUID="e22fabac-8d10-476c-a66c-2d03bbd8ce19" Jul 07 14:10:28.226130 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:28.225869 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w2vcd" podUID="e574e5d9-ef9f-433d-81e0-5d1c7f2976da" Jul 07 14:10:28.226130 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:28.225959 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmdzd" podUID="491931ef-dad1-4f74-97b3-0580ff9abb99" Jul 07 14:10:28.413735 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.413660 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-136.ec2.internal" event="NodeReady" Jul 07 14:10:28.413886 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.413810 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:10:28.463749 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.463715 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v5m6h"] Jul 07 14:10:28.466365 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.466340 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7bc9f"] Jul 07 14:10:28.466492 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.466425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.468111 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.468092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.468497 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.468481 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:10:28.468610 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.468535 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:10:28.468704 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.468630 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vx9nx\"" Jul 07 14:10:28.470453 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.470272 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:10:28.470453 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.470333 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:10:28.470740 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.470719 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nrfgr\"" Jul 07 14:10:28.471013 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.470991 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:10:28.484280 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.484253 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v5m6h"] Jul 07 14:10:28.484984 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.484963 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bc9f"] Jul 07 14:10:28.596375 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.596334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtq5\" (UniqueName: \"kubernetes.io/projected/2f2941d8-aa1a-4d0a-a125-4fd68741834c-kube-api-access-cjtq5\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.596556 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.596413 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2941d8-aa1a-4d0a-a125-4fd68741834c-tmp-dir\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.596556 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.596472 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2941d8-aa1a-4d0a-a125-4fd68741834c-config-volume\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.596556 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.596514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f314389e-e332-4d14-b499-422ab1db91fb-cert\") pod \"ingress-canary-7bc9f\" (UID: \"f314389e-e332-4d14-b499-422ab1db91fb\") " pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.596556 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.596530 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86k6s\" (UniqueName: \"kubernetes.io/projected/f314389e-e332-4d14-b499-422ab1db91fb-kube-api-access-86k6s\") pod \"ingress-canary-7bc9f\" (UID: \"f314389e-e332-4d14-b499-422ab1db91fb\") " pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.596556 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.596549 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.697724 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.697690 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtq5\" (UniqueName: \"kubernetes.io/projected/2f2941d8-aa1a-4d0a-a125-4fd68741834c-kube-api-access-cjtq5\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.697915 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.697745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2941d8-aa1a-4d0a-a125-4fd68741834c-tmp-dir\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.697915 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.697781 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2941d8-aa1a-4d0a-a125-4fd68741834c-config-volume\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.697915 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.697822 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f314389e-e332-4d14-b499-422ab1db91fb-cert\") pod \"ingress-canary-7bc9f\" (UID: \"f314389e-e332-4d14-b499-422ab1db91fb\") " pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.697915 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.697891 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86k6s\" (UniqueName: \"kubernetes.io/projected/f314389e-e332-4d14-b499-422ab1db91fb-kube-api-access-86k6s\") pod \"ingress-canary-7bc9f\" (UID: \"f314389e-e332-4d14-b499-422ab1db91fb\") " pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.697915 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.697915 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.698152 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:28.698041 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:28.698152 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:28.698112 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls podName:2f2941d8-aa1a-4d0a-a125-4fd68741834c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.198093113 +0000 UTC m=+36.552364819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls") pod "dns-default-v5m6h" (UID: "2f2941d8-aa1a-4d0a-a125-4fd68741834c") : secret "dns-default-metrics-tls" not found Jul 07 14:10:28.698152 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.698124 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2941d8-aa1a-4d0a-a125-4fd68741834c-tmp-dir\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.698401 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.698384 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2941d8-aa1a-4d0a-a125-4fd68741834c-config-volume\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.702205 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.702180 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f314389e-e332-4d14-b499-422ab1db91fb-cert\") pod \"ingress-canary-7bc9f\" (UID: \"f314389e-e332-4d14-b499-422ab1db91fb\") " pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.707431 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.707407 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86k6s\" (UniqueName: \"kubernetes.io/projected/f314389e-e332-4d14-b499-422ab1db91fb-kube-api-access-86k6s\") pod \"ingress-canary-7bc9f\" (UID: \"f314389e-e332-4d14-b499-422ab1db91fb\") " pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.707551 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.707530 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtq5\" (UniqueName: \"kubernetes.io/projected/2f2941d8-aa1a-4d0a-a125-4fd68741834c-kube-api-access-cjtq5\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:28.784391 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.784339 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bc9f" Jul 07 14:10:28.924743 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:28.924499 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bc9f"] Jul 07 14:10:28.987147 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:28.987107 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf314389e_e332_4d14_b499_422ab1db91fb.slice/crio-1193ae89b24163546787990173e4fe523817c5e32db4cf3480f8fd16aa14aa04 WatchSource:0}: Error finding container 1193ae89b24163546787990173e4fe523817c5e32db4cf3480f8fd16aa14aa04: Status 404 returned error can't find the container with id 1193ae89b24163546787990173e4fe523817c5e32db4cf3480f8fd16aa14aa04 Jul 07 14:10:29.201944 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:29.201892 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:29.202115 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:29.201964 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:29.202115 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:29.202034 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls podName:2f2941d8-aa1a-4d0a-a125-4fd68741834c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:30.202014799 +0000 UTC m=+37.556286511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls") pod "dns-default-v5m6h" (UID: "2f2941d8-aa1a-4d0a-a125-4fd68741834c") : secret "dns-default-metrics-tls" not found Jul 07 14:10:29.555810 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:29.555774 2569 generic.go:356] "Generic (PLEG): container finished" podID="abc642a7-6b3d-46af-ad43-b896e5231538" containerID="dcdfc88ba4c79a08c34313dbaabe38ab9e876d164a35c3bc78a247db476a4617" exitCode=0 Jul 07 14:10:29.556615 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:29.555863 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerDied","Data":"dcdfc88ba4c79a08c34313dbaabe38ab9e876d164a35c3bc78a247db476a4617"} Jul 07 14:10:29.557358 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:29.557331 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bc9f" event={"ID":"f314389e-e332-4d14-b499-422ab1db91fb","Type":"ContainerStarted","Data":"1193ae89b24163546787990173e4fe523817c5e32db4cf3480f8fd16aa14aa04"} Jul 07 14:10:30.212885 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.212843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:30.213109 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:30.212964 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:30.213109 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:30.213026 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls podName:2f2941d8-aa1a-4d0a-a125-4fd68741834c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.21300702 +0000 UTC m=+39.567278724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls") pod "dns-default-v5m6h" (UID: "2f2941d8-aa1a-4d0a-a125-4fd68741834c") : secret "dns-default-metrics-tls" not found Jul 07 14:10:30.225284 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.225249 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:30.225284 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.225290 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:30.225515 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.225297 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:30.227575 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.227549 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:10:30.227688 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.227586 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:30.228245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.228031 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:30.228245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.228049 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7k5zq\"" Jul 07 14:10:30.228245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.228061 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qhb9j\"" Jul 07 14:10:30.228432 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.228289 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:10:30.563794 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.563705 2569 generic.go:356] "Generic (PLEG): container finished" podID="abc642a7-6b3d-46af-ad43-b896e5231538" containerID="721d0972bc813180b47fb227af1fef70dec1c48375a12bd5846014a8036c5be8" exitCode=0 Jul 07 14:10:30.563794 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:30.563766 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerDied","Data":"721d0972bc813180b47fb227af1fef70dec1c48375a12bd5846014a8036c5be8"} Jul 07 14:10:31.571261 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.569212 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bc9f" event={"ID":"f314389e-e332-4d14-b499-422ab1db91fb","Type":"ContainerStarted","Data":"f6e89a30a4e3ea1225c9e9c363697b52c801571b3bb39bf2d2d2a8cbce6fda7d"} Jul 07 14:10:31.575264 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.575216 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" event={"ID":"abc642a7-6b3d-46af-ad43-b896e5231538","Type":"ContainerStarted","Data":"ec54c6e436dcaab141ddc647cb86c0b7d11d5ec4cdb88dc85e42ad8b9e010efd"} Jul 07 14:10:31.587189 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.587139 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7bc9f" podStartSLOduration=1.387916483 podStartE2EDuration="3.587122958s" totalImagesPullingTime="2.199206475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:31.586407334 +0000 UTC m=+38.940679061" watchObservedRunningTime="2026-07-07 14:10:31.587122958 +0000 UTC m=+38.941394684" Jul 07 14:10:31.614079 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.614012 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jdxcs" podStartSLOduration=7.680826542 podStartE2EDuration="38.613987126s" totalImagesPullingTime="30.933160584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:31.613479882 +0000 UTC m=+38.967751635" watchObservedRunningTime="2026-07-07 14:10:31.613987126 +0000 UTC m=+38.968258854" Jul 07 14:10:31.642511 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.642479 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr"] Jul 07 14:10:31.650738 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.650703 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-88b7cdfd-mlj8v"] Jul 07 14:10:31.650875 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.650835 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.653994 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.653849 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 14:10:31.654142 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.653992 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 14:10:31.654142 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.653996 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:10:31.654276 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.654212 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b9dnq\"" Jul 07 14:10:31.654637 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.654588 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 14:10:31.656869 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.656849 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr"] Jul 07 14:10:31.656989 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.656947 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.659221 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.659187 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nlj6s\"" Jul 07 14:10:31.659221 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.659208 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:10:31.659424 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.659359 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:10:31.659727 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.659708 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:10:31.664414 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.664391 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88b7cdfd-mlj8v"] Jul 07 14:10:31.665279 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.665259 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:10:31.725182 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/73504137-296f-42d3-8f4d-d8602d27c9ce-ca-trust-extracted\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725182 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725182 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-certificates\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b38a8857-5c88-4243-b9ef-e3607703168a-config\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.725412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725247 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5qh\" (UniqueName: \"kubernetes.io/projected/b38a8857-5c88-4243-b9ef-e3607703168a-kube-api-access-9k5qh\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.725412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725270 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b38a8857-5c88-4243-b9ef-e3607703168a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.725412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgwx\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-kube-api-access-qkgwx\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725377 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-trusted-ca\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725680 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-bound-sa-token\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725680 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725548 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-image-registry-private-configuration\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.725680 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.725582 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-installation-pull-secrets\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.747320 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.747289 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fcpt4"] Jul 07 14:10:31.762931 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.762909 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c444f4575-q45nh"] Jul 07 14:10:31.763055 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.763036 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.766709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.766679 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:10:31.766870 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.766851 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 14:10:31.766943 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.766868 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4cmsm\"" Jul 07 14:10:31.767594 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.767573 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 14:10:31.767749 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.767610 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 14:10:31.772891 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.772867 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c444f4575-q45nh"] Jul 07 14:10:31.772989 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.772964 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:31.772989 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.772971 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fcpt4"] Jul 07 14:10:31.774973 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.774954 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 14:10:31.775166 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.775148 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 14:10:31.775503 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.775480 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 14:10:31.775699 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.775681 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 14:10:31.776065 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.776040 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 14:10:31.776191 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.775864 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:10:31.776472 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.775694 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:10:31.776852 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.776834 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zs4qh\"" Jul 07 14:10:31.826245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826146 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-bound-sa-token\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826188 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9955ca92-0fab-41a5-93a9-988ffa54ae16-config\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.826245 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-image-registry-private-configuration\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826460 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826269 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9955ca92-0fab-41a5-93a9-988ffa54ae16-trusted-ca\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.826460 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-installation-pull-secrets\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826460 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvsd4\" (UniqueName: \"kubernetes.io/projected/9955ca92-0fab-41a5-93a9-988ffa54ae16-kube-api-access-mvsd4\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.826460 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/73504137-296f-42d3-8f4d-d8602d27c9ce-ca-trust-extracted\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826465 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-certificates\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9955ca92-0fab-41a5-93a9-988ffa54ae16-serving-cert\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b38a8857-5c88-4243-b9ef-e3607703168a-config\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5qh\" (UniqueName: \"kubernetes.io/projected/b38a8857-5c88-4243-b9ef-e3607703168a-kube-api-access-9k5qh\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826680 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b38a8857-5c88-4243-b9ef-e3607703168a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826704 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgwx\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-kube-api-access-qkgwx\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826733 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.826823 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826756 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-trusted-ca\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.827257 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.826860 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/73504137-296f-42d3-8f4d-d8602d27c9ce-ca-trust-extracted\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.827257 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:31.826972 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:31.827257 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:31.826989 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b7cdfd-mlj8v: secret "image-registry-tls" not found Jul 07 14:10:31.827257 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:31.827059 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls podName:73504137-296f-42d3-8f4d-d8602d27c9ce nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.327037908 +0000 UTC m=+39.681309614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls") pod "image-registry-88b7cdfd-mlj8v" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce") : secret "image-registry-tls" not found Jul 07 14:10:31.827422 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.827402 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b38a8857-5c88-4243-b9ef-e3607703168a-config\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.827456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.827407 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-certificates\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.827837 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.827816 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-trusted-ca\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.830491 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.830470 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b38a8857-5c88-4243-b9ef-e3607703168a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.830579 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.830502 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-image-registry-private-configuration\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.830579 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.830541 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-installation-pull-secrets\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.839059 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.839038 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5qh\" (UniqueName: \"kubernetes.io/projected/b38a8857-5c88-4243-b9ef-e3607703168a-kube-api-access-9k5qh\") pod \"service-ca-operator-5d46d9ffd4-mfttr\" (UID: \"b38a8857-5c88-4243-b9ef-e3607703168a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:31.842267 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.842217 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-bound-sa-token\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.842545 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.842528 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgwx\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-kube-api-access-qkgwx\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:31.927643 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927603 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9955ca92-0fab-41a5-93a9-988ffa54ae16-serving-cert\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.927643 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927641 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-default-certificate\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:31.927903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927659 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:31.927903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927683 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48f4p\" (UniqueName: \"kubernetes.io/projected/aaed9b82-1eb7-4267-bd38-19ac434260d6-kube-api-access-48f4p\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:31.927903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9955ca92-0fab-41a5-93a9-988ffa54ae16-config\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.927903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-stats-auth\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:31.927903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:31.927903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9955ca92-0fab-41a5-93a9-988ffa54ae16-trusted-ca\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.928169 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.927915 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvsd4\" (UniqueName: \"kubernetes.io/projected/9955ca92-0fab-41a5-93a9-988ffa54ae16-kube-api-access-mvsd4\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.928400 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.928382 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9955ca92-0fab-41a5-93a9-988ffa54ae16-config\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.928676 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.928657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9955ca92-0fab-41a5-93a9-988ffa54ae16-trusted-ca\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.929860 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.929842 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9955ca92-0fab-41a5-93a9-988ffa54ae16-serving-cert\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.938559 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.938540 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvsd4\" (UniqueName: \"kubernetes.io/projected/9955ca92-0fab-41a5-93a9-988ffa54ae16-kube-api-access-mvsd4\") pod \"console-operator-68b757fb67-fcpt4\" (UID: \"9955ca92-0fab-41a5-93a9-988ffa54ae16\") " pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:31.962446 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:31.962411 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.029175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-stats-auth\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.029241 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.029365 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-default-certificate\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.029390 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.029425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48f4p\" (UniqueName: \"kubernetes.io/projected/aaed9b82-1eb7-4267-bd38-19ac434260d6-kube-api-access-48f4p\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.029885 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.529864035 +0000 UTC m=+39.884135743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : configmap references non-existent config key: service-ca.crt Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.030118 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:10:32.030189 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.030162 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.530148672 +0000 UTC m=+39.884420382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : secret "router-metrics-certs-default" not found Jul 07 14:10:32.032172 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.032149 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-stats-auth\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.032316 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.032199 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-default-certificate\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.040147 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.039782 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48f4p\" (UniqueName: \"kubernetes.io/projected/aaed9b82-1eb7-4267-bd38-19ac434260d6-kube-api-access-48f4p\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.073595 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.073558 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:32.128877 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.128848 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr"] Jul 07 14:10:32.131985 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:32.131961 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38a8857_5c88_4243_b9ef_e3607703168a.slice/crio-3ebc33a4b8b9df9d02b5d527b7efe1bc1fcf8eb5aa886e55d7ee06bfac74b4ad WatchSource:0}: Error finding container 3ebc33a4b8b9df9d02b5d527b7efe1bc1fcf8eb5aa886e55d7ee06bfac74b4ad: Status 404 returned error can't find the container with id 3ebc33a4b8b9df9d02b5d527b7efe1bc1fcf8eb5aa886e55d7ee06bfac74b4ad Jul 07 14:10:32.230941 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.230887 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:32.231082 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.231040 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:32.231141 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.231111 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls podName:2f2941d8-aa1a-4d0a-a125-4fd68741834c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:36.23109235 +0000 UTC m=+43.585364064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls") pod "dns-default-v5m6h" (UID: "2f2941d8-aa1a-4d0a-a125-4fd68741834c") : secret "dns-default-metrics-tls" not found Jul 07 14:10:32.248481 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.248452 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fcpt4"] Jul 07 14:10:32.251512 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:32.251477 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9955ca92_0fab_41a5_93a9_988ffa54ae16.slice/crio-321a932c6960bd14acc7d7bd0edac9638bfb9868f7840433db5c739e288aea70 WatchSource:0}: Error finding container 321a932c6960bd14acc7d7bd0edac9638bfb9868f7840433db5c739e288aea70: Status 404 returned error can't find the container with id 321a932c6960bd14acc7d7bd0edac9638bfb9868f7840433db5c739e288aea70 Jul 07 14:10:32.332074 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.332034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:32.332278 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.332162 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:32.332278 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.332176 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b7cdfd-mlj8v: secret "image-registry-tls" not found Jul 07 14:10:32.332278 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.332264 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls podName:73504137-296f-42d3-8f4d-d8602d27c9ce nodeName:}" failed. No retries permitted until 2026-07-07 14:10:33.33222327 +0000 UTC m=+40.686494975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls") pod "image-registry-88b7cdfd-mlj8v" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce") : secret "image-registry-tls" not found Jul 07 14:10:32.533181 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.533143 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.533398 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.533203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:32.533398 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.533330 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:10:32.533398 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.533371 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:33.533348391 +0000 UTC m=+40.887620097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : configmap references non-existent config key: service-ca.crt Jul 07 14:10:32.533398 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:32.533400 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:33.533391111 +0000 UTC m=+40.887662823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : secret "router-metrics-certs-default" not found Jul 07 14:10:32.579105 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.579070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" event={"ID":"9955ca92-0fab-41a5-93a9-988ffa54ae16","Type":"ContainerStarted","Data":"321a932c6960bd14acc7d7bd0edac9638bfb9868f7840433db5c739e288aea70"} Jul 07 14:10:32.580244 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:32.580203 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" event={"ID":"b38a8857-5c88-4243-b9ef-e3607703168a","Type":"ContainerStarted","Data":"3ebc33a4b8b9df9d02b5d527b7efe1bc1fcf8eb5aa886e55d7ee06bfac74b4ad"} Jul 07 14:10:33.339683 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:33.339641 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:33.339876 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:33.339817 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:33.339876 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:33.339837 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b7cdfd-mlj8v: secret "image-registry-tls" not found Jul 07 14:10:33.340015 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:33.339908 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls podName:73504137-296f-42d3-8f4d-d8602d27c9ce nodeName:}" failed. No retries permitted until 2026-07-07 14:10:35.339888226 +0000 UTC m=+42.694159937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls") pod "image-registry-88b7cdfd-mlj8v" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce") : secret "image-registry-tls" not found Jul 07 14:10:33.540993 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:33.540952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:33.541170 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:33.541083 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:33.541170 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:33.541126 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:10:33.541283 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:33.541194 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:35.541175358 +0000 UTC m=+42.895447066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : secret "router-metrics-certs-default" not found Jul 07 14:10:33.541283 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:33.541213 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:35.541203007 +0000 UTC m=+42.895474715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : configmap references non-existent config key: service-ca.crt Jul 07 14:10:35.357342 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.357312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:35.357619 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:35.357454 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:35.357619 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:35.357470 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b7cdfd-mlj8v: secret "image-registry-tls" not found Jul 07 14:10:35.357619 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:35.357531 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls podName:73504137-296f-42d3-8f4d-d8602d27c9ce nodeName:}" failed. No retries permitted until 2026-07-07 14:10:39.35751054 +0000 UTC m=+46.711782259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls") pod "image-registry-88b7cdfd-mlj8v" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce") : secret "image-registry-tls" not found Jul 07 14:10:35.559411 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.559320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:35.559567 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.559418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:35.559567 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:35.559470 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:10:35.559567 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:35.559536 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:39.559520767 +0000 UTC m=+46.913792473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : secret "router-metrics-certs-default" not found Jul 07 14:10:35.559567 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:35.559550 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:39.559543831 +0000 UTC m=+46.913815536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : configmap references non-existent config key: service-ca.crt Jul 07 14:10:35.589760 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.589734 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/0.log" Jul 07 14:10:35.589947 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.589770 2569 generic.go:356] "Generic (PLEG): container finished" podID="9955ca92-0fab-41a5-93a9-988ffa54ae16" containerID="9dfdb6617333eb79faf3fd95141dd5a40e746e30a6e999fac32feb28883dc49c" exitCode=255 Jul 07 14:10:35.589947 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.589835 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" event={"ID":"9955ca92-0fab-41a5-93a9-988ffa54ae16","Type":"ContainerDied","Data":"9dfdb6617333eb79faf3fd95141dd5a40e746e30a6e999fac32feb28883dc49c"} Jul 07 14:10:35.590122 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.590104 2569 scope.go:117] "RemoveContainer" containerID="9dfdb6617333eb79faf3fd95141dd5a40e746e30a6e999fac32feb28883dc49c" Jul 07 14:10:35.591419 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.591383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" event={"ID":"b38a8857-5c88-4243-b9ef-e3607703168a","Type":"ContainerStarted","Data":"d3ee1885ee0b329c68bec33cac20408cb83026c5a3e3ee0ba2749193b71dba93"} Jul 07 14:10:35.623458 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:35.623404 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" podStartSLOduration=1.504403313 podStartE2EDuration="4.623381408s" totalImagesPullingTime="3.118978095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:35.622214188 +0000 UTC m=+42.976485937" watchObservedRunningTime="2026-07-07 14:10:35.623381408 +0000 UTC m=+42.977653136" Jul 07 14:10:36.266283 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.266222 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:36.266440 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:36.266376 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:36.266477 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:36.266454 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls podName:2f2941d8-aa1a-4d0a-a125-4fd68741834c nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.266437455 +0000 UTC m=+51.620709165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls") pod "dns-default-v5m6h" (UID: "2f2941d8-aa1a-4d0a-a125-4fd68741834c") : secret "dns-default-metrics-tls" not found Jul 07 14:10:36.595714 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.595639 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:10:36.596126 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.596082 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/0.log" Jul 07 14:10:36.596180 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.596125 2569 generic.go:356] "Generic (PLEG): container finished" podID="9955ca92-0fab-41a5-93a9-988ffa54ae16" containerID="6fafed21336bbad13849ffa70211331a09a9b0f2fb60dd24b717373664454923" exitCode=255 Jul 07 14:10:36.596249 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.596208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" event={"ID":"9955ca92-0fab-41a5-93a9-988ffa54ae16","Type":"ContainerDied","Data":"6fafed21336bbad13849ffa70211331a09a9b0f2fb60dd24b717373664454923"} Jul 07 14:10:36.596308 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.596294 2569 scope.go:117] "RemoveContainer" containerID="9dfdb6617333eb79faf3fd95141dd5a40e746e30a6e999fac32feb28883dc49c" Jul 07 14:10:36.596623 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.596601 2569 scope.go:117] "RemoveContainer" containerID="6fafed21336bbad13849ffa70211331a09a9b0f2fb60dd24b717373664454923" Jul 07 14:10:36.596798 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:36.596780 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fcpt4_openshift-console-operator(9955ca92-0fab-41a5-93a9-988ffa54ae16)\"" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" podUID="9955ca92-0fab-41a5-93a9-988ffa54ae16" Jul 07 14:10:36.891206 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.891126 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rtgw8"] Jul 07 14:10:36.926001 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.925966 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rtgw8"] Jul 07 14:10:36.926170 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.926104 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:36.929478 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.929456 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mts99\"" Jul 07 14:10:36.930087 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.930069 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:10:36.930192 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.930165 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:10:36.930261 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.930168 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:10:36.930314 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:36.930305 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:10:37.072800 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.072757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59ff3474-b183-4d58-960e-8df90955ec1e-data-volume\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.072980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.072831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.072980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.072893 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpcg5\" (UniqueName: \"kubernetes.io/projected/59ff3474-b183-4d58-960e-8df90955ec1e-kube-api-access-xpcg5\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.072980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.072926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.072980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.072965 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59ff3474-b183-4d58-960e-8df90955ec1e-crio-socket\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.173898 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.173810 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.173898 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.173851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpcg5\" (UniqueName: \"kubernetes.io/projected/59ff3474-b183-4d58-960e-8df90955ec1e-kube-api-access-xpcg5\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.173898 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.173881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.174135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.173930 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59ff3474-b183-4d58-960e-8df90955ec1e-crio-socket\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.174135 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.173976 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:37.174135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.174011 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59ff3474-b183-4d58-960e-8df90955ec1e-data-volume\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.174135 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.174021 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:37.174135 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.174050 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:37.674030298 +0000 UTC m=+45.028302023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:37.174135 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.174079 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:37.674062924 +0000 UTC m=+45.028334631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : configmap "kube-rbac-proxy" not found Jul 07 14:10:37.174344 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.174195 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59ff3474-b183-4d58-960e-8df90955ec1e-crio-socket\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.174386 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.174370 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59ff3474-b183-4d58-960e-8df90955ec1e-data-volume\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.182055 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.182030 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpcg5\" (UniqueName: \"kubernetes.io/projected/59ff3474-b183-4d58-960e-8df90955ec1e-kube-api-access-xpcg5\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.603684 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.603658 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:10:37.604181 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.604059 2569 scope.go:117] "RemoveContainer" containerID="6fafed21336bbad13849ffa70211331a09a9b0f2fb60dd24b717373664454923" Jul 07 14:10:37.604292 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.604267 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fcpt4_openshift-console-operator(9955ca92-0fab-41a5-93a9-988ffa54ae16)\"" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" podUID="9955ca92-0fab-41a5-93a9-988ffa54ae16" Jul 07 14:10:37.678635 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.678599 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.678635 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:37.678643 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:37.678862 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.678758 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:37.678862 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.678799 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:37.678862 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.678819 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:38.678803779 +0000 UTC m=+46.033075485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:37.678862 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:37.678847 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:38.678835016 +0000 UTC m=+46.033106725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : configmap "kube-rbac-proxy" not found Jul 07 14:10:38.275782 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:38.275753 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4zpzq_8b95f843-d7a4-48c6-ad9e-c8e104a50488/dns-node-resolver/0.log" Jul 07 14:10:38.688413 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:38.688383 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:38.688789 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:38.688424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:38.688789 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:38.688529 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:38.688789 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:38.688532 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:38.688789 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:38.688580 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:40.688565924 +0000 UTC m=+48.042837629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : configmap "kube-rbac-proxy" not found Jul 07 14:10:38.688789 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:38.688593 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:40.688587233 +0000 UTC m=+48.042858938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:39.277861 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:39.277832 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2glwb_71473ade-a0c9-444c-b26f-b9c2708ea996/node-ca/0.log" Jul 07 14:10:39.395556 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:39.395513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:39.395733 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:39.395629 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:39.395733 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:39.395642 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b7cdfd-mlj8v: secret "image-registry-tls" not found Jul 07 14:10:39.395733 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:39.395689 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls podName:73504137-296f-42d3-8f4d-d8602d27c9ce nodeName:}" failed. No retries permitted until 2026-07-07 14:10:47.395675023 +0000 UTC m=+54.749946729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls") pod "image-registry-88b7cdfd-mlj8v" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce") : secret "image-registry-tls" not found Jul 07 14:10:39.596940 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:39.596851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:39.596940 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:39.596899 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:39.597129 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:39.596992 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:10:39.597129 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:39.597026 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:47.597008569 +0000 UTC m=+54.951280274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : configmap references non-existent config key: service-ca.crt Jul 07 14:10:39.597129 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:39.597051 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:47.597044277 +0000 UTC m=+54.951315982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : secret "router-metrics-certs-default" not found Jul 07 14:10:40.076483 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:40.076454 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bc9f_f314389e-e332-4d14-b499-422ab1db91fb/serve-healthcheck-canary/0.log" Jul 07 14:10:40.705077 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:40.705042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:40.705077 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:40.705082 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:40.705329 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:40.705159 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:10:40.705329 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:40.705194 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:40.705329 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:40.705210 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.705196789 +0000 UTC m=+52.059468495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : configmap "kube-rbac-proxy" not found Jul 07 14:10:40.705329 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:40.705274 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.705254217 +0000 UTC m=+52.059525923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:42.074055 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:42.074011 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:42.074483 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:42.074077 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:42.074483 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:42.074425 2569 scope.go:117] "RemoveContainer" containerID="6fafed21336bbad13849ffa70211331a09a9b0f2fb60dd24b717373664454923" Jul 07 14:10:42.074595 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:42.074573 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fcpt4_openshift-console-operator(9955ca92-0fab-41a5-93a9-988ffa54ae16)\"" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" podUID="9955ca92-0fab-41a5-93a9-988ffa54ae16" Jul 07 14:10:44.336052 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:44.336013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:10:44.336486 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:44.336160 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:44.336486 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:44.336221 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls podName:2f2941d8-aa1a-4d0a-a125-4fd68741834c nodeName:}" failed. No retries permitted until 2026-07-07 14:11:00.33620375 +0000 UTC m=+67.690475463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls") pod "dns-default-v5m6h" (UID: "2f2941d8-aa1a-4d0a-a125-4fd68741834c") : secret "dns-default-metrics-tls" not found Jul 07 14:10:44.739163 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:44.739108 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:44.739385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:44.739173 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:44.739385 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:44.739310 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:10:44.739385 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:44.739377 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls podName:59ff3474-b183-4d58-960e-8df90955ec1e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:52.739360067 +0000 UTC m=+60.093631772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rtgw8" (UID: "59ff3474-b183-4d58-960e-8df90955ec1e") : secret "insights-runtime-extractor-tls" not found Jul 07 14:10:44.739834 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:44.739807 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59ff3474-b183-4d58-960e-8df90955ec1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:47.462210 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:47.462161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:47.464630 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:47.464602 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"image-registry-88b7cdfd-mlj8v\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:47.570270 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:47.570212 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:47.663888 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:47.663859 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:47.664032 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:47.664008 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:10:47.664072 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:47.664031 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:10:47.664106 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:47.664071 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:03.664054641 +0000 UTC m=+71.018326345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : secret "router-metrics-certs-default" not found Jul 07 14:10:47.664163 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:10:47.664152 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle podName:aaed9b82-1eb7-4267-bd38-19ac434260d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:03.664137494 +0000 UTC m=+71.018409200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle") pod "router-default-7c444f4575-q45nh" (UID: "aaed9b82-1eb7-4267-bd38-19ac434260d6") : configmap references non-existent config key: service-ca.crt Jul 07 14:10:47.699972 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:47.699936 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88b7cdfd-mlj8v"] Jul 07 14:10:47.703036 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:47.703006 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73504137_296f_42d3_8f4d_d8602d27c9ce.slice/crio-08d8d39bd270f168c653ab454d020919e25e4865d422b92377fe7fd1d793a2c5 WatchSource:0}: Error finding container 08d8d39bd270f168c653ab454d020919e25e4865d422b92377fe7fd1d793a2c5: Status 404 returned error can't find the container with id 08d8d39bd270f168c653ab454d020919e25e4865d422b92377fe7fd1d793a2c5 Jul 07 14:10:48.631929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:48.631896 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" event={"ID":"73504137-296f-42d3-8f4d-d8602d27c9ce","Type":"ContainerStarted","Data":"26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f"} Jul 07 14:10:48.632464 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:48.631943 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" event={"ID":"73504137-296f-42d3-8f4d-d8602d27c9ce","Type":"ContainerStarted","Data":"08d8d39bd270f168c653ab454d020919e25e4865d422b92377fe7fd1d793a2c5"} Jul 07 14:10:48.632464 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:48.632016 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:10:48.653391 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:48.653338 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" podStartSLOduration=17.653323456 podStartE2EDuration="17.653323456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:48.652532248 +0000 UTC m=+56.006803978" watchObservedRunningTime="2026-07-07 14:10:48.653323456 +0000 UTC m=+56.007595183" Jul 07 14:10:52.805370 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:52.805333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:52.807668 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:52.807642 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59ff3474-b183-4d58-960e-8df90955ec1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtgw8\" (UID: \"59ff3474-b183-4d58-960e-8df90955ec1e\") " pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:52.835640 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:52.835612 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rtgw8" Jul 07 14:10:52.999416 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:52.999370 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rtgw8"] Jul 07 14:10:53.002848 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:53.002815 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ff3474_b183_4d58_960e_8df90955ec1e.slice/crio-cb838595d8a600de1c14d31c4c986e973e630704a046098e69c43bf3c5e809f7 WatchSource:0}: Error finding container cb838595d8a600de1c14d31c4c986e973e630704a046098e69c43bf3c5e809f7: Status 404 returned error can't find the container with id cb838595d8a600de1c14d31c4c986e973e630704a046098e69c43bf3c5e809f7 Jul 07 14:10:53.555196 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:53.555164 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wbqsv" Jul 07 14:10:53.645275 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:53.645222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtgw8" event={"ID":"59ff3474-b183-4d58-960e-8df90955ec1e","Type":"ContainerStarted","Data":"cb838595d8a600de1c14d31c4c986e973e630704a046098e69c43bf3c5e809f7"} Jul 07 14:10:55.226126 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:55.226087 2569 scope.go:117] "RemoveContainer" containerID="6fafed21336bbad13849ffa70211331a09a9b0f2fb60dd24b717373664454923" Jul 07 14:10:57.658400 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.658378 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:10:57.658731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.658461 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" event={"ID":"9955ca92-0fab-41a5-93a9-988ffa54ae16","Type":"ContainerStarted","Data":"8d63733675a3b01601e4217d99093b91d5dbd28ac06933bf272728ad9cfe71a4"} Jul 07 14:10:57.658784 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.658731 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:57.660072 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.660044 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtgw8" event={"ID":"59ff3474-b183-4d58-960e-8df90955ec1e","Type":"ContainerStarted","Data":"0810f83958260c2a90e90a9addc71ba8f01922a4ccb9fb47078facaddb408b13"} Jul 07 14:10:57.663453 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.663435 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" Jul 07 14:10:57.677129 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.677080 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-fcpt4" podStartSLOduration=23.683651134 podStartE2EDuration="26.677065353s" totalImagesPullingTime="2.993414219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:57.676756262 +0000 UTC m=+65.031028007" watchObservedRunningTime="2026-07-07 14:10:57.677065353 +0000 UTC m=+65.031337081" Jul 07 14:10:57.852400 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.852356 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:57.852595 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.852459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:57.854695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.854672 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:57.854809 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.854673 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:57.865516 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.865476 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e574e5d9-ef9f-433d-81e0-5d1c7f2976da-original-pull-secret\") pod \"global-pull-secret-syncer-w2vcd\" (UID: \"e574e5d9-ef9f-433d-81e0-5d1c7f2976da\") " pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:57.865647 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.865550 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491931ef-dad1-4f74-97b3-0580ff9abb99-metrics-certs\") pod \"network-metrics-daemon-dmdzd\" (UID: \"491931ef-dad1-4f74-97b3-0580ff9abb99\") " pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:57.952925 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.952890 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:57.955427 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.955406 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:10:57.966075 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.966051 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:10:57.977000 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:57.976972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6c7p\" (UniqueName: \"kubernetes.io/projected/e22fabac-8d10-476c-a66c-2d03bbd8ce19-kube-api-access-f6c7p\") pod \"network-check-target-4tbs6\" (UID: \"e22fabac-8d10-476c-a66c-2d03bbd8ce19\") " pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:58.139775 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.139748 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qhb9j\"" Jul 07 14:10:58.146195 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.146168 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7k5zq\"" Jul 07 14:10:58.147583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.147567 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:10:58.150710 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.150693 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w2vcd" Jul 07 14:10:58.154591 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.154573 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmdzd" Jul 07 14:10:58.302167 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.302133 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmdzd"] Jul 07 14:10:58.306653 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:58.306618 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491931ef_dad1_4f74_97b3_0580ff9abb99.slice/crio-7b49ef7979a0c2da6cd6d667159d251e6977ab001b66426dd484059c8d58704d WatchSource:0}: Error finding container 7b49ef7979a0c2da6cd6d667159d251e6977ab001b66426dd484059c8d58704d: Status 404 returned error can't find the container with id 7b49ef7979a0c2da6cd6d667159d251e6977ab001b66426dd484059c8d58704d Jul 07 14:10:58.319923 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.319889 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4tbs6"] Jul 07 14:10:58.323912 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:58.323881 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22fabac_8d10_476c_a66c_2d03bbd8ce19.slice/crio-578dc256fe6cc1f57c8b8fa6c26f1a2e87c7c444984fc7b10b7e81b066c955d8 WatchSource:0}: Error finding container 578dc256fe6cc1f57c8b8fa6c26f1a2e87c7c444984fc7b10b7e81b066c955d8: Status 404 returned error can't find the container with id 578dc256fe6cc1f57c8b8fa6c26f1a2e87c7c444984fc7b10b7e81b066c955d8 Jul 07 14:10:58.341086 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.341055 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w2vcd"] Jul 07 14:10:58.345305 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:10:58.345272 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode574e5d9_ef9f_433d_81e0_5d1c7f2976da.slice/crio-d7f42712cdaff0c540a63d099349cf2cfad7746820749bef047943080436cf21 WatchSource:0}: Error finding container d7f42712cdaff0c540a63d099349cf2cfad7746820749bef047943080436cf21: Status 404 returned error can't find the container with id d7f42712cdaff0c540a63d099349cf2cfad7746820749bef047943080436cf21 Jul 07 14:10:58.665561 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.665470 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w2vcd" event={"ID":"e574e5d9-ef9f-433d-81e0-5d1c7f2976da","Type":"ContainerStarted","Data":"d7f42712cdaff0c540a63d099349cf2cfad7746820749bef047943080436cf21"} Jul 07 14:10:58.667542 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.667502 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtgw8" event={"ID":"59ff3474-b183-4d58-960e-8df90955ec1e","Type":"ContainerStarted","Data":"5d5bc01dd38fd60f882265e92a5aa06185d351b88bf4e2bfacc947f97f43fcc5"} Jul 07 14:10:58.668796 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.668767 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmdzd" event={"ID":"491931ef-dad1-4f74-97b3-0580ff9abb99","Type":"ContainerStarted","Data":"7b49ef7979a0c2da6cd6d667159d251e6977ab001b66426dd484059c8d58704d"} Jul 07 14:10:58.670068 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:10:58.670039 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4tbs6" event={"ID":"e22fabac-8d10-476c-a66c-2d03bbd8ce19","Type":"ContainerStarted","Data":"578dc256fe6cc1f57c8b8fa6c26f1a2e87c7c444984fc7b10b7e81b066c955d8"} Jul 07 14:11:00.375379 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:00.375325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:11:00.379451 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:00.379102 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2941d8-aa1a-4d0a-a125-4fd68741834c-metrics-tls\") pod \"dns-default-v5m6h\" (UID: \"2f2941d8-aa1a-4d0a-a125-4fd68741834c\") " pod="openshift-dns/dns-default-v5m6h" Jul 07 14:11:00.581092 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:00.581060 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vx9nx\"" Jul 07 14:11:00.588429 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:00.588395 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5m6h" Jul 07 14:11:03.266178 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.266146 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn"] Jul 07 14:11:03.293544 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.290880 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn"] Jul 07 14:11:03.293544 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.292444 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.297246 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.295263 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88b7cdfd-mlj8v"] Jul 07 14:11:03.297246 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.295759 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.302449 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.300112 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 14:11:03.302449 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.300267 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 14:11:03.302449 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.300382 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 14:11:03.302449 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.300601 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 14:11:03.304952 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.304724 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 14:11:03.306429 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.306370 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn"] Jul 07 14:11:03.307656 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.307564 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6v5mq\"" Jul 07 14:11:03.307656 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.307591 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn"] Jul 07 14:11:03.313851 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.313557 2569 patch_prober.go:28] interesting pod/image-registry-88b7cdfd-mlj8v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 14:11:03.313851 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.313649 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:11:03.406555 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.406518 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mn58\" (UniqueName: \"kubernetes.io/projected/6c8ed889-97cd-414b-b797-8d6d7bb7fd19-kube-api-access-9mn58\") pod \"managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn\" (UID: \"6c8ed889-97cd-414b-b797-8d6d7bb7fd19\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.406744 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.406574 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-klusterlet-config\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.406744 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.406626 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c8ed889-97cd-414b-b797-8d6d7bb7fd19-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn\" (UID: \"6c8ed889-97cd-414b-b797-8d6d7bb7fd19\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.406744 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.406681 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2gv\" (UniqueName: \"kubernetes.io/projected/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-kube-api-access-pj2gv\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.406744 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.406730 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-tmp\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.507313 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.507277 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-tmp\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.507514 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.507353 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mn58\" (UniqueName: \"kubernetes.io/projected/6c8ed889-97cd-414b-b797-8d6d7bb7fd19-kube-api-access-9mn58\") pod \"managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn\" (UID: \"6c8ed889-97cd-414b-b797-8d6d7bb7fd19\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.507514 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.507402 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-klusterlet-config\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.507514 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.507429 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c8ed889-97cd-414b-b797-8d6d7bb7fd19-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn\" (UID: \"6c8ed889-97cd-414b-b797-8d6d7bb7fd19\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.507514 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.507468 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2gv\" (UniqueName: \"kubernetes.io/projected/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-kube-api-access-pj2gv\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.507777 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.507752 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-tmp\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.510365 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.510336 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-klusterlet-config\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.510483 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.510336 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c8ed889-97cd-414b-b797-8d6d7bb7fd19-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn\" (UID: \"6c8ed889-97cd-414b-b797-8d6d7bb7fd19\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.527529 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.527450 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mn58\" (UniqueName: \"kubernetes.io/projected/6c8ed889-97cd-414b-b797-8d6d7bb7fd19-kube-api-access-9mn58\") pod \"managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn\" (UID: \"6c8ed889-97cd-414b-b797-8d6d7bb7fd19\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.527903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.527843 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2gv\" (UniqueName: \"kubernetes.io/projected/8c66bb51-8efe-4c24-a84e-f2971d82ec8b-kube-api-access-pj2gv\") pod \"klusterlet-addon-workmgr-685846b6d6-j6bvn\" (UID: \"8c66bb51-8efe-4c24-a84e-f2971d82ec8b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.620072 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.620036 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:03.632954 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.632925 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" Jul 07 14:11:03.708839 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.708796 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:03.709015 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.708859 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:03.709634 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.709603 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaed9b82-1eb7-4267-bd38-19ac434260d6-service-ca-bundle\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:03.711581 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.711556 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaed9b82-1eb7-4267-bd38-19ac434260d6-metrics-certs\") pod \"router-default-7c444f4575-q45nh\" (UID: \"aaed9b82-1eb7-4267-bd38-19ac434260d6\") " pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:03.888156 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.888068 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zs4qh\"" Jul 07 14:11:03.896338 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:03.896307 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:04.156488 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.155437 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c444f4575-q45nh"] Jul 07 14:11:04.163158 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:04.162758 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaed9b82_1eb7_4267_bd38_19ac434260d6.slice/crio-0c01bc4c4bc94212fffddb817fa5478bba862433f8906dfc627e07e489841d2a WatchSource:0}: Error finding container 0c01bc4c4bc94212fffddb817fa5478bba862433f8906dfc627e07e489841d2a: Status 404 returned error can't find the container with id 0c01bc4c4bc94212fffddb817fa5478bba862433f8906dfc627e07e489841d2a Jul 07 14:11:04.164366 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.164312 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn"] Jul 07 14:11:04.169211 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:04.169182 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c8ed889_97cd_414b_b797_8d6d7bb7fd19.slice/crio-e9f3c635f3525865897728520a717bf3d25b6fa1b1587692d0bde856c9fc260c WatchSource:0}: Error finding container e9f3c635f3525865897728520a717bf3d25b6fa1b1587692d0bde856c9fc260c: Status 404 returned error can't find the container with id e9f3c635f3525865897728520a717bf3d25b6fa1b1587692d0bde856c9fc260c Jul 07 14:11:04.175329 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.175264 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn"] Jul 07 14:11:04.182490 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:04.182462 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c66bb51_8efe_4c24_a84e_f2971d82ec8b.slice/crio-0c279d92d937c14a241a8ff57ad0196a24eda6e821bee6a800fed1ed0a2b963e WatchSource:0}: Error finding container 0c279d92d937c14a241a8ff57ad0196a24eda6e821bee6a800fed1ed0a2b963e: Status 404 returned error can't find the container with id 0c279d92d937c14a241a8ff57ad0196a24eda6e821bee6a800fed1ed0a2b963e Jul 07 14:11:04.202602 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.202540 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v5m6h"] Jul 07 14:11:04.696387 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.696340 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w2vcd" event={"ID":"e574e5d9-ef9f-433d-81e0-5d1c7f2976da","Type":"ContainerStarted","Data":"ff65d8b32767838d56238471c84fc5c2ab21d123505b5cc58bbfae9c3817c2b3"} Jul 07 14:11:04.701976 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.701414 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtgw8" event={"ID":"59ff3474-b183-4d58-960e-8df90955ec1e","Type":"ContainerStarted","Data":"c9433f4815ece6a6a5ee70efd9a7d2d733f07070bde44a2c8437239995fc94e5"} Jul 07 14:11:04.704596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.704145 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c444f4575-q45nh" event={"ID":"aaed9b82-1eb7-4267-bd38-19ac434260d6","Type":"ContainerStarted","Data":"9d418df6fea2cde7ee2caca3e234ba8800b90e4e6ccea368742cef06bc5984f5"} Jul 07 14:11:04.704596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.704193 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c444f4575-q45nh" event={"ID":"aaed9b82-1eb7-4267-bd38-19ac434260d6","Type":"ContainerStarted","Data":"0c01bc4c4bc94212fffddb817fa5478bba862433f8906dfc627e07e489841d2a"} Jul 07 14:11:04.705495 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.705471 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5m6h" event={"ID":"2f2941d8-aa1a-4d0a-a125-4fd68741834c","Type":"ContainerStarted","Data":"10399970bede84127e93ac5411b7e935575f96c60d414e761381179f7a56e773"} Jul 07 14:11:04.706940 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.706916 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" event={"ID":"8c66bb51-8efe-4c24-a84e-f2971d82ec8b","Type":"ContainerStarted","Data":"0c279d92d937c14a241a8ff57ad0196a24eda6e821bee6a800fed1ed0a2b963e"} Jul 07 14:11:04.709164 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.709136 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmdzd" event={"ID":"491931ef-dad1-4f74-97b3-0580ff9abb99","Type":"ContainerStarted","Data":"1a6ed4b7916b6cdafbff4000d52dc6083ed77fd7992b35b190a93210ca2f1d12"} Jul 07 14:11:04.709298 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.709183 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmdzd" event={"ID":"491931ef-dad1-4f74-97b3-0580ff9abb99","Type":"ContainerStarted","Data":"2e97c104d2ae1fa3747d3f592f845780b04ab609016dbded80444f5665b82c75"} Jul 07 14:11:04.711343 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.711318 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4tbs6" event={"ID":"e22fabac-8d10-476c-a66c-2d03bbd8ce19","Type":"ContainerStarted","Data":"326d63bc8c0493f9db63c8c3c0d394905ecbb38f02142989f7b24e3a1abc69d7"} Jul 07 14:11:04.711808 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.711759 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:11:04.713558 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.713537 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" event={"ID":"6c8ed889-97cd-414b-b797-8d6d7bb7fd19","Type":"ContainerStarted","Data":"e9f3c635f3525865897728520a717bf3d25b6fa1b1587692d0bde856c9fc260c"} Jul 07 14:11:04.720372 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.720319 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w2vcd" podStartSLOduration=66.114536338 podStartE2EDuration="1m11.720302084s" totalImagesPullingTime="5.605765746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:04.719129347 +0000 UTC m=+72.073401100" watchObservedRunningTime="2026-07-07 14:11:04.720302084 +0000 UTC m=+72.074573809" Jul 07 14:11:04.775569 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.774613 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c444f4575-q45nh" podStartSLOduration=33.774594945 podStartE2EDuration="33.774594945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:04.772471744 +0000 UTC m=+72.126743465" watchObservedRunningTime="2026-07-07 14:11:04.774594945 +0000 UTC m=+72.128866676" Jul 07 14:11:04.796583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.796522 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rtgw8" podStartSLOduration=17.999231078 podStartE2EDuration="28.796499947s" totalImagesPullingTime="10.797268869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:10:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:04.796325393 +0000 UTC m=+72.150597121" watchObservedRunningTime="2026-07-07 14:11:04.796499947 +0000 UTC m=+72.150771676" Jul 07 14:11:04.818090 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.816837 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dmdzd" podStartSLOduration=66.218312118 podStartE2EDuration="1m11.816813823s" totalImagesPullingTime="5.598501705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:04.815379892 +0000 UTC m=+72.169651619" watchObservedRunningTime="2026-07-07 14:11:04.816813823 +0000 UTC m=+72.171085551" Jul 07 14:11:04.839199 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.839097 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4tbs6" podStartSLOduration=66.230376081 podStartE2EDuration="1m11.839076031s" totalImagesPullingTime="5.60869995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:04.838709554 +0000 UTC m=+72.192981283" watchObservedRunningTime="2026-07-07 14:11:04.839076031 +0000 UTC m=+72.193347761" Jul 07 14:11:04.896518 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.896479 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:04.899848 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:04.899799 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:05.719098 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:05.719067 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:05.720607 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:05.720584 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c444f4575-q45nh" Jul 07 14:11:06.328796 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:06.328748 2569 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:7c661382812d5f112f986e7821aa7b048a85788fc571cdd6622344cbfe09b45d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 07 14:11:06.329000 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:06.328885 2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-685846b6d6-j6bvn_open-cluster-management-agent-addon(8c66bb51-8efe-4c24-a84e-f2971d82ec8b): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:7c661382812d5f112f986e7821aa7b048a85788fc571cdd6622344cbfe09b45d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 07 14:11:06.329000 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:06.328927 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:7c661382812d5f112f986e7821aa7b048a85788fc571cdd6622344cbfe09b45d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" podUID="8c66bb51-8efe-4c24-a84e-f2971d82ec8b" Jul 07 14:11:06.723516 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:06.723479 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:7c661382812d5f112f986e7821aa7b048a85788fc571cdd6622344cbfe09b45d: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" podUID="8c66bb51-8efe-4c24-a84e-f2971d82ec8b" Jul 07 14:11:07.726777 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:07.726742 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" event={"ID":"6c8ed889-97cd-414b-b797-8d6d7bb7fd19","Type":"ContainerStarted","Data":"b1005b06a96cbb482f38f752d50339aeeaa47b00c5f24d5437ab8687968dbcd0"} Jul 07 14:11:07.728579 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:07.728543 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5m6h" event={"ID":"2f2941d8-aa1a-4d0a-a125-4fd68741834c","Type":"ContainerStarted","Data":"f458e40f943d5f484b50c9c846fca8da003de05148c507751de0055d85a89f47"} Jul 07 14:11:07.728709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:07.728613 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5m6h" event={"ID":"2f2941d8-aa1a-4d0a-a125-4fd68741834c","Type":"ContainerStarted","Data":"1ae1770466c39371bf4066cc5005ea9349895b6e90bc8c0ae3ca0ac856f065f0"} Jul 07 14:11:07.750375 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:07.750327 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b96dd5c8-zcjfn" podStartSLOduration=1.903594703 podStartE2EDuration="4.750305147s" totalImagesPullingTime="2.846710444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:07.749762377 +0000 UTC m=+75.104034105" watchObservedRunningTime="2026-07-07 14:11:07.750305147 +0000 UTC m=+75.104576874" Jul 07 14:11:07.780646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:07.780592 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v5m6h" podStartSLOduration=36.971752265 podStartE2EDuration="39.780577829s" totalImagesPullingTime="2.808825564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:07.776966418 +0000 UTC m=+75.131238146" watchObservedRunningTime="2026-07-07 14:11:07.780577829 +0000 UTC m=+75.134849583" Jul 07 14:11:08.732558 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:08.732521 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v5m6h" Jul 07 14:11:13.300493 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:13.300455 2569 patch_prober.go:28] interesting pod/image-registry-88b7cdfd-mlj8v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 14:11:13.300953 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:13.300516 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:11:18.738866 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:18.738748 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v5m6h" Jul 07 14:11:23.301380 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:23.301350 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:11:25.795548 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:25.795459 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" event={"ID":"8c66bb51-8efe-4c24-a84e-f2971d82ec8b","Type":"ContainerStarted","Data":"2c92164c81e58ad9d4363df8ce03aaf225b05322481725bb0721ed8f9bec8a4e"} Jul 07 14:11:25.795982 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:25.795739 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:25.797464 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:25.797446 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" Jul 07 14:11:25.813357 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:25.813306 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685846b6d6-j6bvn" podStartSLOduration=1.522231203 podStartE2EDuration="22.813289892s" totalImagesPullingTime="21.291058689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-07 14:11:25.812677412 +0000 UTC m=+93.166949152" watchObservedRunningTime="2026-07-07 14:11:25.813289892 +0000 UTC m=+93.167561618" Jul 07 14:11:28.334303 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.334219 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerName="registry" containerID="cri-o://26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f" gracePeriod=30 Jul 07 14:11:28.578479 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.578456 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:11:28.710289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710256 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710325 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-image-registry-private-configuration\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710349 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-trusted-ca\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710371 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-installation-pull-secrets\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710403 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkgwx\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-kube-api-access-qkgwx\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710438 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-bound-sa-token\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710700 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710477 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/73504137-296f-42d3-8f4d-d8602d27c9ce-ca-trust-extracted\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.710700 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.710504 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-certificates\") pod \"73504137-296f-42d3-8f4d-d8602d27c9ce\" (UID: \"73504137-296f-42d3-8f4d-d8602d27c9ce\") " Jul 07 14:11:28.711041 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.711011 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:28.711168 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.711051 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:11:28.712928 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.712882 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:28.712928 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.712911 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:11:28.713102 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.713014 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-kube-api-access-qkgwx" (OuterVolumeSpecName: "kube-api-access-qkgwx") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "kube-api-access-qkgwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:28.713102 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.713040 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:11:28.713102 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.713068 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:11:28.719627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.719600 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73504137-296f-42d3-8f4d-d8602d27c9ce-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "73504137-296f-42d3-8f4d-d8602d27c9ce" (UID: "73504137-296f-42d3-8f4d-d8602d27c9ce"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:11:28.806222 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.806189 2569 generic.go:356] "Generic (PLEG): container finished" podID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerID="26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f" exitCode=0 Jul 07 14:11:28.806412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.806254 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" Jul 07 14:11:28.806412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.806270 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" event={"ID":"73504137-296f-42d3-8f4d-d8602d27c9ce","Type":"ContainerDied","Data":"26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f"} Jul 07 14:11:28.806412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.806342 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b7cdfd-mlj8v" event={"ID":"73504137-296f-42d3-8f4d-d8602d27c9ce","Type":"ContainerDied","Data":"08d8d39bd270f168c653ab454d020919e25e4865d422b92377fe7fd1d793a2c5"} Jul 07 14:11:28.806412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.806362 2569 scope.go:117] "RemoveContainer" containerID="26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f" Jul 07 14:11:28.811088 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811063 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-image-registry-private-configuration\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811091 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-trusted-ca\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811109 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/73504137-296f-42d3-8f4d-d8602d27c9ce-installation-pull-secrets\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811124 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkgwx\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-kube-api-access-qkgwx\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811139 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-bound-sa-token\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811153 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/73504137-296f-42d3-8f4d-d8602d27c9ce-ca-trust-extracted\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811166 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-certificates\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.811214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.811209 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/73504137-296f-42d3-8f4d-d8602d27c9ce-registry-tls\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:11:28.814783 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.814766 2569 scope.go:117] "RemoveContainer" containerID="26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f" Jul 07 14:11:28.815065 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:28.815044 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f\": container with ID starting with 26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f not found: ID does not exist" containerID="26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f" Jul 07 14:11:28.815134 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.815072 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f"} err="failed to get container status \"26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f\": rpc error: code = NotFound desc = could not find container \"26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f\": container with ID starting with 26458ea8f56bb18995b06e91e48c6800f898719a66cc57df7b13d8001c46b17f not found: ID does not exist" Jul 07 14:11:28.828500 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.828476 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88b7cdfd-mlj8v"] Jul 07 14:11:28.836406 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:28.836379 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-88b7cdfd-mlj8v"] Jul 07 14:11:29.229597 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:29.229568 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" path="/var/lib/kubelet/pods/73504137-296f-42d3-8f4d-d8602d27c9ce/volumes" Jul 07 14:11:30.801176 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.801143 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hxbll"] Jul 07 14:11:30.801691 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.801382 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerName="registry" Jul 07 14:11:30.801691 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.801393 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerName="registry" Jul 07 14:11:30.801691 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.801433 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="73504137-296f-42d3-8f4d-d8602d27c9ce" containerName="registry" Jul 07 14:11:30.904342 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.904315 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:30.906598 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.906572 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:11:30.906761 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.906651 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:11:30.907062 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.907035 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:11:30.907062 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.907078 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:11:30.907062 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.907091 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:11:30.907361 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.907127 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6f247\"" Jul 07 14:11:30.907790 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:30.907772 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:11:31.026980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.026943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-tls\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.026980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.026987 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-wtmp\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027107 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-sys\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027148 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-metrics-client-ca\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027180 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbmr6\" (UniqueName: \"kubernetes.io/projected/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-kube-api-access-fbmr6\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-textfile\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027255 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-accelerators-collector-config\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.027289 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.027281 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-root\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128357 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128273 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-sys\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128357 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-metrics-client-ca\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128357 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbmr6\" (UniqueName: \"kubernetes.io/projected/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-kube-api-access-fbmr6\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128588 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128382 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-textfile\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128588 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128385 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-sys\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128588 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-accelerators-collector-config\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128588 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128520 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-root\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128764 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128599 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-tls\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128764 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128634 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128764 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128662 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-wtmp\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128764 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128703 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-root\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128764 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128754 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-textfile\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128991 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:31.128807 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:11:31.128991 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.128829 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-wtmp\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.128991 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:11:31.128878 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-tls podName:0c57c36f-f0f7-4eec-9cc1-4cb7b4911494 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:31.628856929 +0000 UTC m=+98.983128648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-tls") pod "node-exporter-hxbll" (UID: "0c57c36f-f0f7-4eec-9cc1-4cb7b4911494") : secret "node-exporter-tls" not found Jul 07 14:11:31.129162 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.129012 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-metrics-client-ca\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.129162 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.129011 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-accelerators-collector-config\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.130839 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.130820 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.137766 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.137745 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbmr6\" (UniqueName: \"kubernetes.io/projected/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-kube-api-access-fbmr6\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.633583 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.633534 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-tls\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.635814 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.635793 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c57c36f-f0f7-4eec-9cc1-4cb7b4911494-node-exporter-tls\") pod \"node-exporter-hxbll\" (UID: \"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494\") " pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.813494 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:31.813456 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hxbll" Jul 07 14:11:31.858919 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:31.858891 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c57c36f_f0f7_4eec_9cc1_4cb7b4911494.slice/crio-5d10518d5be7ab2681b141ff52318f13cb2f291e72f4fb2a103ea6f9ac7c5a8f WatchSource:0}: Error finding container 5d10518d5be7ab2681b141ff52318f13cb2f291e72f4fb2a103ea6f9ac7c5a8f: Status 404 returned error can't find the container with id 5d10518d5be7ab2681b141ff52318f13cb2f291e72f4fb2a103ea6f9ac7c5a8f Jul 07 14:11:32.077678 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.077646 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:11:32.110158 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.110120 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:11:32.110322 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.110259 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.112818 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.112771 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:11:32.112818 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.112794 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:11:32.113037 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.112794 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:11:32.113037 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.112785 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:11:32.113037 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.112795 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:11:32.113203 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.113186 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-62dhx\"" Jul 07 14:11:32.113313 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.113298 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:11:32.113402 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.113385 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:11:32.113482 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.113467 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:11:32.118713 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.118694 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:11:32.238667 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238629 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87j27\" (UniqueName: \"kubernetes.io/projected/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-kube-api-access-87j27\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238667 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238690 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238718 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238794 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238843 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-config-out\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238887 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.238929 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238922 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-web-config\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.239160 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.238972 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.239160 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.239003 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.239160 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.239030 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.239160 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.239055 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.239160 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.239074 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340316 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340211 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340316 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340273 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-web-config\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340316 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340299 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340316 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340341 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340371 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340396 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87j27\" (UniqueName: \"kubernetes.io/projected/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-kube-api-access-87j27\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340451 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340477 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340545 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.340646 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.340578 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-config-out\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.343210 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.343180 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-config-out\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.344326 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.343705 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.344479 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.344453 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-web-config\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.344720 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.344591 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.344932 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.344908 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.345138 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.345050 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.345138 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.345113 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.345546 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.345525 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.345650 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.345557 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.345715 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.345665 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.346217 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.346194 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.347343 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.347319 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.353218 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.353193 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87j27\" (UniqueName: \"kubernetes.io/projected/2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1-kube-api-access-87j27\") pod \"alertmanager-main-0\" (UID: \"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.420031 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.419997 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:32.587549 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.587518 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:11:32.592150 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:32.592084 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df2aeeb_bdf6_44e4_aca9_50b23c70bfe1.slice/crio-b9ec2fd4008e9f054d54d305f230a6ae76945dfc2f079cf17bd434bea4e699c4 WatchSource:0}: Error finding container b9ec2fd4008e9f054d54d305f230a6ae76945dfc2f079cf17bd434bea4e699c4: Status 404 returned error can't find the container with id b9ec2fd4008e9f054d54d305f230a6ae76945dfc2f079cf17bd434bea4e699c4 Jul 07 14:11:32.823605 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.823563 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"b9ec2fd4008e9f054d54d305f230a6ae76945dfc2f079cf17bd434bea4e699c4"} Jul 07 14:11:32.825021 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:32.824977 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hxbll" event={"ID":"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494","Type":"ContainerStarted","Data":"5d10518d5be7ab2681b141ff52318f13cb2f291e72f4fb2a103ea6f9ac7c5a8f"} Jul 07 14:11:33.831939 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:33.831900 2569 generic.go:356] "Generic (PLEG): container finished" podID="0c57c36f-f0f7-4eec-9cc1-4cb7b4911494" containerID="e3b4f51d136827108f85942d85dce636e647c27b8f33452a110eae094730990e" exitCode=0 Jul 07 14:11:33.832402 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:33.831955 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hxbll" event={"ID":"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494","Type":"ContainerDied","Data":"e3b4f51d136827108f85942d85dce636e647c27b8f33452a110eae094730990e"} Jul 07 14:11:34.837152 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:34.837116 2569 generic.go:356] "Generic (PLEG): container finished" podID="2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1" containerID="007d8eba32a5b3b7ea63f6935edec3634bc898a25664eb32121ddbfc2e5e2edf" exitCode=0 Jul 07 14:11:34.837589 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:34.837190 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerDied","Data":"007d8eba32a5b3b7ea63f6935edec3634bc898a25664eb32121ddbfc2e5e2edf"} Jul 07 14:11:34.839603 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:34.839576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hxbll" event={"ID":"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494","Type":"ContainerStarted","Data":"1c9deb8fd2a805bb3fbd5fc69fb333050a235ed3be53cd93756df57cd5b57f89"} Jul 07 14:11:34.839698 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:34.839641 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hxbll" event={"ID":"0c57c36f-f0f7-4eec-9cc1-4cb7b4911494","Type":"ContainerStarted","Data":"b62d10960263d9ad0e7036ea3449a453725700f73fc9c89e6ba663453ddaefa3"} Jul 07 14:11:34.890494 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:34.890437 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hxbll" podStartSLOduration=3.360486426 podStartE2EDuration="4.890420371s" totalImagesPullingTime="1.424937364s" totalInitContainerRuntime="104.996581ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:34.889653297 +0000 UTC m=+102.243925042" watchObservedRunningTime="2026-07-07 14:11:34.890420371 +0000 UTC m=+102.244692098" Jul 07 14:11:35.182469 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.182376 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-df759f9c9-l9hlj"] Jul 07 14:11:35.206806 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.206775 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-df759f9c9-l9hlj"] Jul 07 14:11:35.206973 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.206896 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.210473 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.210452 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:11:35.210615 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.210556 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 14:11:35.210846 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.210820 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bfh3m0cear9bf\"" Jul 07 14:11:35.210846 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.210823 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 14:11:35.211035 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.210903 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lqpjc\"" Jul 07 14:11:35.211439 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.211424 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 14:11:35.367155 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-secret-metrics-server-tls\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.367155 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367157 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3636bb60-9378-49c2-977f-ed0b355f5ace-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.367456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367182 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-client-ca-bundle\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.367456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367261 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nngnh\" (UniqueName: \"kubernetes.io/projected/3636bb60-9378-49c2-977f-ed0b355f5ace-kube-api-access-nngnh\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.367456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3636bb60-9378-49c2-977f-ed0b355f5ace-metrics-server-audit-profiles\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.367456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3636bb60-9378-49c2-977f-ed0b355f5ace-audit-log\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.367456 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.367340 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-secret-metrics-server-client-certs\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nngnh\" (UniqueName: \"kubernetes.io/projected/3636bb60-9378-49c2-977f-ed0b355f5ace-kube-api-access-nngnh\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3636bb60-9378-49c2-977f-ed0b355f5ace-metrics-server-audit-profiles\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468843 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468625 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3636bb60-9378-49c2-977f-ed0b355f5ace-audit-log\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468843 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468659 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-secret-metrics-server-client-certs\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468843 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468680 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-secret-metrics-server-tls\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468843 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3636bb60-9378-49c2-977f-ed0b355f5ace-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.468843 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.468727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-client-ca-bundle\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.469177 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.469146 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3636bb60-9378-49c2-977f-ed0b355f5ace-audit-log\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.469460 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.469440 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3636bb60-9378-49c2-977f-ed0b355f5ace-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.469776 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.469757 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3636bb60-9378-49c2-977f-ed0b355f5ace-metrics-server-audit-profiles\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.471321 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.471274 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-secret-metrics-server-client-certs\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.471743 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.471719 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-client-ca-bundle\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.471816 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.471769 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3636bb60-9378-49c2-977f-ed0b355f5ace-secret-metrics-server-tls\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.484448 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.484374 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nngnh\" (UniqueName: \"kubernetes.io/projected/3636bb60-9378-49c2-977f-ed0b355f5ace-kube-api-access-nngnh\") pod \"metrics-server-df759f9c9-l9hlj\" (UID: \"3636bb60-9378-49c2-977f-ed0b355f5ace\") " pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.516400 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.516355 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:35.568380 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.568342 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z"] Jul 07 14:11:35.595845 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.595793 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z"] Jul 07 14:11:35.595990 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.595931 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.598907 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.598873 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 14:11:35.598907 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.598885 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p2r4q\"" Jul 07 14:11:35.685645 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.685616 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-df759f9c9-l9hlj"] Jul 07 14:11:35.689167 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:35.689120 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3636bb60_9378_49c2_977f_ed0b355f5ace.slice/crio-0ae9283f76d1b85da0f7c9579b22a34174fec73c4d11eccf5414489af1fce579 WatchSource:0}: Error finding container 0ae9283f76d1b85da0f7c9579b22a34174fec73c4d11eccf5414489af1fce579: Status 404 returned error can't find the container with id 0ae9283f76d1b85da0f7c9579b22a34174fec73c4d11eccf5414489af1fce579 Jul 07 14:11:35.720965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.720882 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4tbs6" Jul 07 14:11:35.770762 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.770719 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/592b4a9c-75d6-4a0c-bd5c-d6222cb109da-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bwc8z\" (UID: \"592b4a9c-75d6-4a0c-bd5c-d6222cb109da\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.770921 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.770857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zszlk\" (UniqueName: \"kubernetes.io/projected/592b4a9c-75d6-4a0c-bd5c-d6222cb109da-kube-api-access-zszlk\") pod \"monitoring-plugin-d5dcff7cf-bwc8z\" (UID: \"592b4a9c-75d6-4a0c-bd5c-d6222cb109da\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.845057 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.845020 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" event={"ID":"3636bb60-9378-49c2-977f-ed0b355f5ace","Type":"ContainerStarted","Data":"0ae9283f76d1b85da0f7c9579b22a34174fec73c4d11eccf5414489af1fce579"} Jul 07 14:11:35.871771 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.871736 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/592b4a9c-75d6-4a0c-bd5c-d6222cb109da-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bwc8z\" (UID: \"592b4a9c-75d6-4a0c-bd5c-d6222cb109da\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.871966 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.871809 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zszlk\" (UniqueName: \"kubernetes.io/projected/592b4a9c-75d6-4a0c-bd5c-d6222cb109da-kube-api-access-zszlk\") pod \"monitoring-plugin-d5dcff7cf-bwc8z\" (UID: \"592b4a9c-75d6-4a0c-bd5c-d6222cb109da\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.874198 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.874173 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/592b4a9c-75d6-4a0c-bd5c-d6222cb109da-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bwc8z\" (UID: \"592b4a9c-75d6-4a0c-bd5c-d6222cb109da\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.880057 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.880035 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zszlk\" (UniqueName: \"kubernetes.io/projected/592b4a9c-75d6-4a0c-bd5c-d6222cb109da-kube-api-access-zszlk\") pod \"monitoring-plugin-d5dcff7cf-bwc8z\" (UID: \"592b4a9c-75d6-4a0c-bd5c-d6222cb109da\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.915284 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.915250 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:35.992080 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:35.991990 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fcf894bf4-thnzj"] Jul 07 14:11:36.013214 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.013178 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fcf894bf4-thnzj"] Jul 07 14:11:36.013352 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.013299 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.015720 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.015679 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 14:11:36.015720 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.015690 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 14:11:36.015907 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.015731 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 14:11:36.015907 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.015837 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 14:11:36.016014 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.016000 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 14:11:36.016079 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.016064 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pxq8x\"" Jul 07 14:11:36.027102 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.027067 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 14:11:36.085012 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.084983 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z"] Jul 07 14:11:36.087610 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:36.087588 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592b4a9c_75d6_4a0c_bd5c_d6222cb109da.slice/crio-fcfe1aa6eea7c20706b8dd6fb2b629da09bd08bad4bde698b0bf2abf7f2cb71e WatchSource:0}: Error finding container fcfe1aa6eea7c20706b8dd6fb2b629da09bd08bad4bde698b0bf2abf7f2cb71e: Status 404 returned error can't find the container with id fcfe1aa6eea7c20706b8dd6fb2b629da09bd08bad4bde698b0bf2abf7f2cb71e Jul 07 14:11:36.175549 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175498 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-metrics-client-ca\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175734 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-federate-client-tls\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175770 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-serving-certs-ca-bundle\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175998 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g6cr\" (UniqueName: \"kubernetes.io/projected/1d482203-4dfc-4624-8ee3-c3aa9ad88636-kube-api-access-8g6cr\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175998 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175830 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-secret-telemeter-client\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.175998 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.175891 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-telemeter-client-tls\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277471 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277386 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-telemeter-client-tls\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277471 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277441 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277500 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-metrics-client-ca\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277531 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-federate-client-tls\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277598 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-serving-certs-ca-bundle\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g6cr\" (UniqueName: \"kubernetes.io/projected/1d482203-4dfc-4624-8ee3-c3aa9ad88636-kube-api-access-8g6cr\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.277695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.277656 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-secret-telemeter-client\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.278709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.278652 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-metrics-client-ca\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.279067 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.279020 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.279181 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.279103 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d482203-4dfc-4624-8ee3-c3aa9ad88636-serving-certs-ca-bundle\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.280996 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.280973 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-secret-telemeter-client\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.281117 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.281002 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.281191 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.281171 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-federate-client-tls\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.281255 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.281212 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d482203-4dfc-4624-8ee3-c3aa9ad88636-telemeter-client-tls\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.286867 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.286842 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g6cr\" (UniqueName: \"kubernetes.io/projected/1d482203-4dfc-4624-8ee3-c3aa9ad88636-kube-api-access-8g6cr\") pod \"telemeter-client-fcf894bf4-thnzj\" (UID: \"1d482203-4dfc-4624-8ee3-c3aa9ad88636\") " pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.329917 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.329885 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" Jul 07 14:11:36.533552 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.533503 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fcf894bf4-thnzj"] Jul 07 14:11:36.849971 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:36.849894 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" event={"ID":"592b4a9c-75d6-4a0c-bd5c-d6222cb109da","Type":"ContainerStarted","Data":"fcfe1aa6eea7c20706b8dd6fb2b629da09bd08bad4bde698b0bf2abf7f2cb71e"} Jul 07 14:11:36.922548 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:36.922506 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d482203_4dfc_4624_8ee3_c3aa9ad88636.slice/crio-3bd82d7c54fddde97879e239635f5b97f6485cda8f56ea696bee1e82b0c0833f WatchSource:0}: Error finding container 3bd82d7c54fddde97879e239635f5b97f6485cda8f56ea696bee1e82b0c0833f: Status 404 returned error can't find the container with id 3bd82d7c54fddde97879e239635f5b97f6485cda8f56ea696bee1e82b0c0833f Jul 07 14:11:37.854896 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:37.854861 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" event={"ID":"1d482203-4dfc-4624-8ee3-c3aa9ad88636","Type":"ContainerStarted","Data":"3bd82d7c54fddde97879e239635f5b97f6485cda8f56ea696bee1e82b0c0833f"} Jul 07 14:11:38.861282 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:38.861211 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"331d81391c2f818661e809eeb74ebe69e0f27e8c12238171ded098d293f43c09"} Jul 07 14:11:38.861675 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:38.861315 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"a2872911d3ca0815b496c150100a50edc60ace8b059349310be01dfd103d426b"} Jul 07 14:11:38.862853 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:38.862824 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" event={"ID":"3636bb60-9378-49c2-977f-ed0b355f5ace","Type":"ContainerStarted","Data":"5e225f2c831b8171707f10734f6d82c4f5463385dc030dda9954875a87724bc9"} Jul 07 14:11:38.882295 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:38.882249 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" podStartSLOduration=1.043807459 podStartE2EDuration="3.882216416s" totalImagesPullingTime="2.838408957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:38.880853149 +0000 UTC m=+106.235124879" watchObservedRunningTime="2026-07-07 14:11:38.882216416 +0000 UTC m=+106.236488143" Jul 07 14:11:39.870209 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:39.870175 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"d9a6ee5d3c6838bb2151ad0ede063b30b49cebad49893c0f005c08a2e75cf537"} Jul 07 14:11:39.870658 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:39.870275 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"bfb508ebad1209fcbfe7852b54c6cf216846bc15c336dce4865845c123b4acd1"} Jul 07 14:11:39.870658 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:39.870309 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"a1269d09bb60e3a808c6b1b26cafb4e0f2d759420b9eeedbab047cc4730a5f99"} Jul 07 14:11:39.871672 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:39.871647 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" event={"ID":"592b4a9c-75d6-4a0c-bd5c-d6222cb109da","Type":"ContainerStarted","Data":"b2823b1eb31e36f00508df6f33a45252db706ed031cab96293d3159b370bdd42"} Jul 07 14:11:39.894514 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:39.894467 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" podStartSLOduration=2.145828606 podStartE2EDuration="4.89445109s" totalImagesPullingTime="2.748622484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:39.892820314 +0000 UTC m=+107.247092042" watchObservedRunningTime="2026-07-07 14:11:39.89445109 +0000 UTC m=+107.248722817" Jul 07 14:11:40.879206 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.879165 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1","Type":"ContainerStarted","Data":"cdfc5e39420d58ab37b4ff01fc03ef5649bec7f8c86177474baa052a64736e34"} Jul 07 14:11:40.881286 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.881257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" event={"ID":"1d482203-4dfc-4624-8ee3-c3aa9ad88636","Type":"ContainerStarted","Data":"1b069816410accd1093f895d055852481e0412036c039424ba6559cfe7354282"} Jul 07 14:11:40.881420 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.881309 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" event={"ID":"1d482203-4dfc-4624-8ee3-c3aa9ad88636","Type":"ContainerStarted","Data":"bec72c7182c3bb95facd2d4345daaf0b2df663df1aeb7a1525581e1f609a3d0d"} Jul 07 14:11:40.881420 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.881329 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" event={"ID":"1d482203-4dfc-4624-8ee3-c3aa9ad88636","Type":"ContainerStarted","Data":"d85ebc7755f80747d3f7732f9dd3eaeab5e55319cd27723068cc9d485ce0a051"} Jul 07 14:11:40.881533 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.881519 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:40.886359 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.886338 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bwc8z" Jul 07 14:11:40.911178 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.911126 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.188889281 podStartE2EDuration="8.911104258s" totalImagesPullingTime="5.693706281s" totalInitContainerRuntime="28.508696ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:40.909725071 +0000 UTC m=+108.263996800" watchObservedRunningTime="2026-07-07 14:11:40.911104258 +0000 UTC m=+108.265375997" Jul 07 14:11:40.953177 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:40.953102 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fcf894bf4-thnzj" podStartSLOduration=2.982533842 podStartE2EDuration="5.953077009s" totalImagesPullingTime="2.970543167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:40.950997973 +0000 UTC m=+108.305269727" watchObservedRunningTime="2026-07-07 14:11:40.953077009 +0000 UTC m=+108.307348737" Jul 07 14:11:41.739360 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.739318 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cf7b8cb6b-qlfm7"] Jul 07 14:11:41.741500 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.741484 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.744044 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.744022 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:11:41.744444 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.744427 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:11:41.744594 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.744577 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:11:41.744744 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.744729 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:11:41.744815 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.744772 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:11:41.745537 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.745518 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:11:41.746323 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.746295 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:11:41.746586 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.746536 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6rsp2\"" Jul 07 14:11:41.755127 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.755111 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:11:41.768832 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.768809 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf7b8cb6b-qlfm7"] Jul 07 14:11:41.932947 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.932910 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-serving-cert\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.933385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.932963 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-oauth-serving-cert\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.933385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.933018 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-console-config\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.933385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.933043 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8zkp\" (UniqueName: \"kubernetes.io/projected/568e1431-a1af-463c-9b85-8508c5142c6e-kube-api-access-w8zkp\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.933385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.933068 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-oauth-config\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.933385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.933091 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-trusted-ca-bundle\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:41.933385 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:41.933125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-service-ca\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.034262 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.034155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-oauth-config\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.034262 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.034195 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-trusted-ca-bundle\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.034679 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.034656 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-service-ca\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.034813 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.034779 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-serving-cert\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.035049 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.035026 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-oauth-serving-cert\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.035190 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.035164 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-trusted-ca-bundle\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.035435 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.035397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-service-ca\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.035635 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.035610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-console-config\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.035814 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.035777 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8zkp\" (UniqueName: \"kubernetes.io/projected/568e1431-a1af-463c-9b85-8508c5142c6e-kube-api-access-w8zkp\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.035932 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.035905 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-oauth-serving-cert\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.036493 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.036469 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-console-config\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.037143 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.037121 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-oauth-config\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.037433 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.037417 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-serving-cert\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.046768 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.046737 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8zkp\" (UniqueName: \"kubernetes.io/projected/568e1431-a1af-463c-9b85-8508c5142c6e-kube-api-access-w8zkp\") pod \"console-5cf7b8cb6b-qlfm7\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.051366 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.051346 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:42.183081 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.183044 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf7b8cb6b-qlfm7"] Jul 07 14:11:42.185930 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:11:42.185901 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568e1431_a1af_463c_9b85_8508c5142c6e.slice/crio-a02a6617e933a740605b23625b2fe4c4671d7f376e46c618fb3b1fd0fa5fe022 WatchSource:0}: Error finding container a02a6617e933a740605b23625b2fe4c4671d7f376e46c618fb3b1fd0fa5fe022: Status 404 returned error can't find the container with id a02a6617e933a740605b23625b2fe4c4671d7f376e46c618fb3b1fd0fa5fe022 Jul 07 14:11:42.892020 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:42.891976 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf7b8cb6b-qlfm7" event={"ID":"568e1431-a1af-463c-9b85-8508c5142c6e","Type":"ContainerStarted","Data":"a02a6617e933a740605b23625b2fe4c4671d7f376e46c618fb3b1fd0fa5fe022"} Jul 07 14:11:45.911177 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:45.911139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf7b8cb6b-qlfm7" event={"ID":"568e1431-a1af-463c-9b85-8508c5142c6e","Type":"ContainerStarted","Data":"8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2"} Jul 07 14:11:45.933076 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:45.933012 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cf7b8cb6b-qlfm7" podStartSLOduration=1.962885657 podStartE2EDuration="4.932995666s" totalImagesPullingTime="2.970110009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:45.932188608 +0000 UTC m=+113.286460353" watchObservedRunningTime="2026-07-07 14:11:45.932995666 +0000 UTC m=+113.287267445" Jul 07 14:11:46.916582 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:46.916544 2569 generic.go:356] "Generic (PLEG): container finished" podID="b38a8857-5c88-4243-b9ef-e3607703168a" containerID="d3ee1885ee0b329c68bec33cac20408cb83026c5a3e3ee0ba2749193b71dba93" exitCode=0 Jul 07 14:11:46.916987 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:46.916617 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" event={"ID":"b38a8857-5c88-4243-b9ef-e3607703168a","Type":"ContainerDied","Data":"d3ee1885ee0b329c68bec33cac20408cb83026c5a3e3ee0ba2749193b71dba93"} Jul 07 14:11:46.917059 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:46.917042 2569 scope.go:117] "RemoveContainer" containerID="d3ee1885ee0b329c68bec33cac20408cb83026c5a3e3ee0ba2749193b71dba93" Jul 07 14:11:47.922008 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:47.921971 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mfttr" event={"ID":"b38a8857-5c88-4243-b9ef-e3607703168a","Type":"ContainerStarted","Data":"01d91192eec0b760004dc8d835b0e91d85d72bf13c53ef3bcd19dd7240f4aa61"} Jul 07 14:11:52.052299 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:52.052209 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:52.052299 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:52.052303 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:52.057033 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:52.057009 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:52.944307 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:52.944282 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:11:55.516914 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:55.516868 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:11:55.517325 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:11:55.516936 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:12:15.522078 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:15.522047 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:12:15.526067 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:15.526044 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-df759f9c9-l9hlj" Jul 07 14:12:57.540081 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.539999 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfdcfb88d-pnzvh"] Jul 07 14:12:57.543733 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.543706 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.555222 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.555195 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfdcfb88d-pnzvh"] Jul 07 14:12:57.656835 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.656793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-console-config\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.656835 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.656840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-oauth-serving-cert\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.657071 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.656908 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-oauth-config\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.657071 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.656961 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-serving-cert\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.657071 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.656979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcgmw\" (UniqueName: \"kubernetes.io/projected/ed165be4-e551-429d-9bf1-d79d96df19a6-kube-api-access-rcgmw\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.657071 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.656996 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-service-ca\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.657071 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.657030 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-trusted-ca-bundle\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758122 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758082 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-serving-cert\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758122 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758119 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcgmw\" (UniqueName: \"kubernetes.io/projected/ed165be4-e551-429d-9bf1-d79d96df19a6-kube-api-access-rcgmw\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758413 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758136 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-service-ca\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758413 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-trusted-ca-bundle\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758413 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-console-config\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758413 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758303 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-oauth-serving-cert\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.758590 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.758443 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-oauth-config\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.759128 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.759095 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-service-ca\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.759277 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.759096 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-console-config\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.759277 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.759134 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-oauth-serving-cert\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.759277 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.759133 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-trusted-ca-bundle\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.760730 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.760707 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-serving-cert\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.760915 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.760893 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-oauth-config\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.765936 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.765911 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcgmw\" (UniqueName: \"kubernetes.io/projected/ed165be4-e551-429d-9bf1-d79d96df19a6-kube-api-access-rcgmw\") pod \"console-5dfdcfb88d-pnzvh\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.854045 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.853949 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:12:57.990179 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:57.990140 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfdcfb88d-pnzvh"] Jul 07 14:12:57.993106 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:12:57.993079 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded165be4_e551_429d_9bf1_d79d96df19a6.slice/crio-af8d37ac1947842cf500fd03e2d9a3cd474a08f53d482a9723900aa3f11966e7 WatchSource:0}: Error finding container af8d37ac1947842cf500fd03e2d9a3cd474a08f53d482a9723900aa3f11966e7: Status 404 returned error can't find the container with id af8d37ac1947842cf500fd03e2d9a3cd474a08f53d482a9723900aa3f11966e7 Jul 07 14:12:58.186899 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:58.186808 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdcfb88d-pnzvh" event={"ID":"ed165be4-e551-429d-9bf1-d79d96df19a6","Type":"ContainerStarted","Data":"d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f"} Jul 07 14:12:58.186899 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:58.186887 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdcfb88d-pnzvh" event={"ID":"ed165be4-e551-429d-9bf1-d79d96df19a6","Type":"ContainerStarted","Data":"af8d37ac1947842cf500fd03e2d9a3cd474a08f53d482a9723900aa3f11966e7"} Jul 07 14:12:58.204788 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:12:58.204720 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dfdcfb88d-pnzvh" podStartSLOduration=1.204699086 podStartE2EDuration="1.204699086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:58.203674117 +0000 UTC m=+185.557945857" watchObservedRunningTime="2026-07-07 14:12:58.204699086 +0000 UTC m=+185.558970825" Jul 07 14:13:07.854154 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:07.854105 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:13:07.854564 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:07.854182 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:13:07.858925 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:07.858902 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:13:08.227882 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:08.227854 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:13:08.282778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:08.282738 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf7b8cb6b-qlfm7"] Jul 07 14:13:33.304523 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.304460 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cf7b8cb6b-qlfm7" podUID="568e1431-a1af-463c-9b85-8508c5142c6e" containerName="console" containerID="cri-o://8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2" gracePeriod=15 Jul 07 14:13:33.554788 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.554723 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:13:33.570536 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570508 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-oauth-serving-cert\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.570536 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570540 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8zkp\" (UniqueName: \"kubernetes.io/projected/568e1431-a1af-463c-9b85-8508c5142c6e-kube-api-access-w8zkp\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.570778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570576 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-service-ca\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.570778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570615 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-trusted-ca-bundle\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.570778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570722 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-serving-cert\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.570778 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570775 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-oauth-config\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.570984 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.570800 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-console-config\") pod \"568e1431-a1af-463c-9b85-8508c5142c6e\" (UID: \"568e1431-a1af-463c-9b85-8508c5142c6e\") " Jul 07 14:13:33.571060 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.571022 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-service-ca" (OuterVolumeSpecName: "service-ca") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:33.571135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.571028 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:33.571135 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.571022 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:33.571418 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.571390 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-console-config" (OuterVolumeSpecName: "console-config") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:13:33.573051 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.573001 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:13:33.573202 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.573120 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/568e1431-a1af-463c-9b85-8508c5142c6e-kube-api-access-w8zkp" (OuterVolumeSpecName: "kube-api-access-w8zkp") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "kube-api-access-w8zkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:13:33.573202 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.573121 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "568e1431-a1af-463c-9b85-8508c5142c6e" (UID: "568e1431-a1af-463c-9b85-8508c5142c6e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:13:33.672241 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672183 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-trusted-ca-bundle\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:33.672407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672252 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-serving-cert\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:33.672407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672271 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568e1431-a1af-463c-9b85-8508c5142c6e-console-oauth-config\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:33.672407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672285 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-console-config\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:33.672407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672301 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-oauth-serving-cert\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:33.672407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672318 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8zkp\" (UniqueName: \"kubernetes.io/projected/568e1431-a1af-463c-9b85-8508c5142c6e-kube-api-access-w8zkp\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:33.672407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:33.672333 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568e1431-a1af-463c-9b85-8508c5142c6e-service-ca\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:13:34.318840 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.318801 2569 generic.go:356] "Generic (PLEG): container finished" podID="568e1431-a1af-463c-9b85-8508c5142c6e" containerID="8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2" exitCode=0 Jul 07 14:13:34.319377 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.318868 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf7b8cb6b-qlfm7" Jul 07 14:13:34.319377 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.318891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf7b8cb6b-qlfm7" event={"ID":"568e1431-a1af-463c-9b85-8508c5142c6e","Type":"ContainerDied","Data":"8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2"} Jul 07 14:13:34.319377 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.318947 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf7b8cb6b-qlfm7" event={"ID":"568e1431-a1af-463c-9b85-8508c5142c6e","Type":"ContainerDied","Data":"a02a6617e933a740605b23625b2fe4c4671d7f376e46c618fb3b1fd0fa5fe022"} Jul 07 14:13:34.319377 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.318969 2569 scope.go:117] "RemoveContainer" containerID="8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2" Jul 07 14:13:34.327593 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.327578 2569 scope.go:117] "RemoveContainer" containerID="8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2" Jul 07 14:13:34.327844 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:13:34.327828 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2\": container with ID starting with 8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2 not found: ID does not exist" containerID="8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2" Jul 07 14:13:34.327890 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.327853 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2"} err="failed to get container status \"8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2\": rpc error: code = NotFound desc = could not find container \"8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2\": container with ID starting with 8201df27795f65473d731e795d38faaeaf75d4328459c6c78e7b6fe975a361c2 not found: ID does not exist" Jul 07 14:13:34.338137 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.338113 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf7b8cb6b-qlfm7"] Jul 07 14:13:34.342006 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:34.341984 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cf7b8cb6b-qlfm7"] Jul 07 14:13:35.230379 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:13:35.230343 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="568e1431-a1af-463c-9b85-8508c5142c6e" path="/var/lib/kubelet/pods/568e1431-a1af-463c-9b85-8508c5142c6e/volumes" Jul 07 14:14:27.124731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.124650 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv"] Jul 07 14:14:27.125211 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.124925 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568e1431-a1af-463c-9b85-8508c5142c6e" containerName="console" Jul 07 14:14:27.125211 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.124935 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="568e1431-a1af-463c-9b85-8508c5142c6e" containerName="console" Jul 07 14:14:27.125211 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.125010 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="568e1431-a1af-463c-9b85-8508c5142c6e" containerName="console" Jul 07 14:14:27.127787 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.127772 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.130015 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.129991 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 07 14:14:27.130143 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.130125 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-pvdx5\"" Jul 07 14:14:27.130257 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.130221 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 07 14:14:27.130571 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.130555 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 07 14:14:27.130676 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.130599 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 07 14:14:27.130676 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.130658 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 07 14:14:27.140338 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.140315 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv"] Jul 07 14:14:27.325371 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.325340 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/061cc16b-d489-4403-9b17-95fa41013b66-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.325554 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.325390 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-certificates\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.325554 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.325454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjbqh\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-kube-api-access-vjbqh\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.426288 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.426175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjbqh\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-kube-api-access-vjbqh\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.426432 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.426303 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/061cc16b-d489-4403-9b17-95fa41013b66-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.426432 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.426332 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-certificates\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.426516 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:14:27.426431 2569 secret.go:281] references non-existent secret key: tls.crt Jul 07 14:14:27.426516 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:14:27.426447 2569 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 07 14:14:27.426516 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:14:27.426466 2569 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 07 14:14:27.426516 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:14:27.426484 2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 07 14:14:27.426646 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:14:27.426554 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-certificates podName:061cc16b-d489-4403-9b17-95fa41013b66 nodeName:}" failed. No retries permitted until 2026-07-07 14:14:27.926536981 +0000 UTC m=+275.280808742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-certificates") pod "keda-metrics-apiserver-559f75f947-jr5gv" (UID: "061cc16b-d489-4403-9b17-95fa41013b66") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 07 14:14:27.426728 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.426708 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/061cc16b-d489-4403-9b17-95fa41013b66-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.436946 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.436910 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjbqh\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-kube-api-access-vjbqh\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.931296 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.931259 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-certificates\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.933825 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.933793 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/061cc16b-d489-4403-9b17-95fa41013b66-certificates\") pod \"keda-metrics-apiserver-559f75f947-jr5gv\" (UID: \"061cc16b-d489-4403-9b17-95fa41013b66\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:27.964003 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.963969 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-pwkpz"] Jul 07 14:14:27.967361 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.967344 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:27.969854 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.969837 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 07 14:14:27.981610 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:27.981585 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-pwkpz"] Jul 07 14:14:28.031863 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.031827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thnkl\" (UniqueName: \"kubernetes.io/projected/6c8b9073-d4ed-4859-94fa-dc133418e04e-kube-api-access-thnkl\") pod \"keda-admission-5fbd5c4644-pwkpz\" (UID: \"6c8b9073-d4ed-4859-94fa-dc133418e04e\") " pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.032016 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.031875 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6c8b9073-d4ed-4859-94fa-dc133418e04e-certificates\") pod \"keda-admission-5fbd5c4644-pwkpz\" (UID: \"6c8b9073-d4ed-4859-94fa-dc133418e04e\") " pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.038789 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.038764 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:28.132765 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.132735 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thnkl\" (UniqueName: \"kubernetes.io/projected/6c8b9073-d4ed-4859-94fa-dc133418e04e-kube-api-access-thnkl\") pod \"keda-admission-5fbd5c4644-pwkpz\" (UID: \"6c8b9073-d4ed-4859-94fa-dc133418e04e\") " pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.133221 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.132789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6c8b9073-d4ed-4859-94fa-dc133418e04e-certificates\") pod \"keda-admission-5fbd5c4644-pwkpz\" (UID: \"6c8b9073-d4ed-4859-94fa-dc133418e04e\") " pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.135426 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.135401 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6c8b9073-d4ed-4859-94fa-dc133418e04e-certificates\") pod \"keda-admission-5fbd5c4644-pwkpz\" (UID: \"6c8b9073-d4ed-4859-94fa-dc133418e04e\") " pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.140684 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.140658 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thnkl\" (UniqueName: \"kubernetes.io/projected/6c8b9073-d4ed-4859-94fa-dc133418e04e-kube-api-access-thnkl\") pod \"keda-admission-5fbd5c4644-pwkpz\" (UID: \"6c8b9073-d4ed-4859-94fa-dc133418e04e\") " pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.172043 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.171944 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv"] Jul 07 14:14:28.174716 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:14:28.174684 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061cc16b_d489_4403_9b17_95fa41013b66.slice/crio-d327715c7237e2ab30599011aa644bf322313633374a4a1fd780abad53675b48 WatchSource:0}: Error finding container d327715c7237e2ab30599011aa644bf322313633374a4a1fd780abad53675b48: Status 404 returned error can't find the container with id d327715c7237e2ab30599011aa644bf322313633374a4a1fd780abad53675b48 Jul 07 14:14:28.277825 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.277791 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:28.411869 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.411742 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-pwkpz"] Jul 07 14:14:28.414296 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:14:28.414270 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8b9073_d4ed_4859_94fa_dc133418e04e.slice/crio-8e7b456dd9dddb64439e24eba4bd5b05a4a32d9fb2aa1cf9df40f34ef435c04a WatchSource:0}: Error finding container 8e7b456dd9dddb64439e24eba4bd5b05a4a32d9fb2aa1cf9df40f34ef435c04a: Status 404 returned error can't find the container with id 8e7b456dd9dddb64439e24eba4bd5b05a4a32d9fb2aa1cf9df40f34ef435c04a Jul 07 14:14:28.522300 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.522265 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" event={"ID":"6c8b9073-d4ed-4859-94fa-dc133418e04e","Type":"ContainerStarted","Data":"8e7b456dd9dddb64439e24eba4bd5b05a4a32d9fb2aa1cf9df40f34ef435c04a"} Jul 07 14:14:28.523503 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:28.523474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" event={"ID":"061cc16b-d489-4403-9b17-95fa41013b66","Type":"ContainerStarted","Data":"d327715c7237e2ab30599011aa644bf322313633374a4a1fd780abad53675b48"} Jul 07 14:14:32.542802 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:32.542765 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" event={"ID":"061cc16b-d489-4403-9b17-95fa41013b66","Type":"ContainerStarted","Data":"519065f0567ef32e81015f33fbc0f83d976446c47068a9df64caf979910689f0"} Jul 07 14:14:32.543367 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:32.542928 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:32.544263 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:32.544222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" event={"ID":"6c8b9073-d4ed-4859-94fa-dc133418e04e","Type":"ContainerStarted","Data":"e2e10a23e25181fc40fbe444a42dd6810ec60c256799d62a9998130532e9bcce"} Jul 07 14:14:32.544378 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:32.544367 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:14:32.572317 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:32.572264 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" podStartSLOduration=1.818589416 podStartE2EDuration="5.572246577s" totalImagesPullingTime="3.753657161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:32.570745727 +0000 UTC m=+279.925017454" watchObservedRunningTime="2026-07-07 14:14:32.572246577 +0000 UTC m=+279.926518304" Jul 07 14:14:32.593125 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:32.593081 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" podStartSLOduration=2.079642418 podStartE2EDuration="5.593064695s" totalImagesPullingTime="3.513422277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:32.592371648 +0000 UTC m=+279.946643398" watchObservedRunningTime="2026-07-07 14:14:32.593064695 +0000 UTC m=+279.947336425" Jul 07 14:14:43.553005 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:43.552975 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-jr5gv" Jul 07 14:14:53.038770 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:53.038743 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:14:53.042353 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:53.042326 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:14:53.042848 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:53.042823 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:14:53.046657 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:53.046623 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:14:53.049719 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:53.049699 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:14:53.550864 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:14:53.550830 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-pwkpz" Jul 07 14:15:36.032027 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.031987 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-dn9k4"] Jul 07 14:15:36.034314 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.034292 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.038825 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.038799 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 07 14:15:36.038946 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.038868 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-2dslx\"" Jul 07 14:15:36.039268 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.039250 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 14:15:36.039500 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.039485 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 14:15:36.051028 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.051003 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-dn9k4"] Jul 07 14:15:36.098029 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.097992 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.098211 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.098073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hxwp\" (UniqueName: \"kubernetes.io/projected/8e29bbe2-b413-4515-a739-ac5beea74172-kube-api-access-5hxwp\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.198787 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.198753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxwp\" (UniqueName: \"kubernetes.io/projected/8e29bbe2-b413-4515-a739-ac5beea74172-kube-api-access-5hxwp\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.198986 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.198818 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.198986 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:15:36.198929 2569 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 14:15:36.199098 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:15:36.199011 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert podName:8e29bbe2-b413-4515-a739-ac5beea74172 nodeName:}" failed. No retries permitted until 2026-07-07 14:15:36.698994599 +0000 UTC m=+344.053266303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert") pod "kserve-controller-manager-7598d7bb4-dn9k4" (UID: "8e29bbe2-b413-4515-a739-ac5beea74172") : secret "kserve-webhook-server-cert" not found Jul 07 14:15:36.214601 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.214573 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hxwp\" (UniqueName: \"kubernetes.io/projected/8e29bbe2-b413-4515-a739-ac5beea74172-kube-api-access-5hxwp\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.702835 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:36.702800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:36.703034 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:15:36.702988 2569 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 14:15:36.703091 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:15:36.703079 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert podName:8e29bbe2-b413-4515-a739-ac5beea74172 nodeName:}" failed. No retries permitted until 2026-07-07 14:15:37.703062531 +0000 UTC m=+345.057334237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert") pod "kserve-controller-manager-7598d7bb4-dn9k4" (UID: "8e29bbe2-b413-4515-a739-ac5beea74172") : secret "kserve-webhook-server-cert" not found Jul 07 14:15:37.711169 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:37.711131 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:37.713653 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:37.713628 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") pod \"kserve-controller-manager-7598d7bb4-dn9k4\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:37.844692 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:37.844654 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:37.974270 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:37.974169 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-dn9k4"] Jul 07 14:15:37.977191 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:15:37.977165 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e29bbe2_b413_4515_a739_ac5beea74172.slice/crio-a7e0d38678427a5b009539643a9102b89c13d800ed5d672c31da9e62ead45a68 WatchSource:0}: Error finding container a7e0d38678427a5b009539643a9102b89c13d800ed5d672c31da9e62ead45a68: Status 404 returned error can't find the container with id a7e0d38678427a5b009539643a9102b89c13d800ed5d672c31da9e62ead45a68 Jul 07 14:15:37.978581 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:37.978561 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:15:38.802301 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:38.802259 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" event={"ID":"8e29bbe2-b413-4515-a739-ac5beea74172","Type":"ContainerStarted","Data":"a7e0d38678427a5b009539643a9102b89c13d800ed5d672c31da9e62ead45a68"} Jul 07 14:15:41.816143 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:41.816102 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" event={"ID":"8e29bbe2-b413-4515-a739-ac5beea74172","Type":"ContainerStarted","Data":"938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7"} Jul 07 14:15:41.816573 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:41.816406 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:15:41.835828 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:15:41.835767 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" podStartSLOduration=2.773210523 podStartE2EDuration="5.83574916s" totalImagesPullingTime="3.062538637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:41.834152833 +0000 UTC m=+349.188424554" watchObservedRunningTime="2026-07-07 14:15:41.83574916 +0000 UTC m=+349.190020888" Jul 07 14:16:11.872639 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.872548 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-dn9k4"] Jul 07 14:16:11.873193 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.872812 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" podUID="8e29bbe2-b413-4515-a739-ac5beea74172" containerName="manager" containerID="cri-o://938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7" gracePeriod=10 Jul 07 14:16:11.878028 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.878003 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:16:11.898687 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.898662 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-lwkjw"] Jul 07 14:16:11.900654 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.900638 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:11.911882 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.911855 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-lwkjw"] Jul 07 14:16:11.916600 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.916576 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e22769ed-dbfa-48f4-b8aa-2b507b691e89-cert\") pod \"kserve-controller-manager-7598d7bb4-lwkjw\" (UID: \"e22769ed-dbfa-48f4-b8aa-2b507b691e89\") " pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:11.916685 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:11.916629 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vk47\" (UniqueName: \"kubernetes.io/projected/e22769ed-dbfa-48f4-b8aa-2b507b691e89-kube-api-access-9vk47\") pod \"kserve-controller-manager-7598d7bb4-lwkjw\" (UID: \"e22769ed-dbfa-48f4-b8aa-2b507b691e89\") " pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.017956 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.017905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e22769ed-dbfa-48f4-b8aa-2b507b691e89-cert\") pod \"kserve-controller-manager-7598d7bb4-lwkjw\" (UID: \"e22769ed-dbfa-48f4-b8aa-2b507b691e89\") " pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.018131 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.017968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vk47\" (UniqueName: \"kubernetes.io/projected/e22769ed-dbfa-48f4-b8aa-2b507b691e89-kube-api-access-9vk47\") pod \"kserve-controller-manager-7598d7bb4-lwkjw\" (UID: \"e22769ed-dbfa-48f4-b8aa-2b507b691e89\") " pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.020364 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.020337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e22769ed-dbfa-48f4-b8aa-2b507b691e89-cert\") pod \"kserve-controller-manager-7598d7bb4-lwkjw\" (UID: \"e22769ed-dbfa-48f4-b8aa-2b507b691e89\") " pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.026458 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.026431 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vk47\" (UniqueName: \"kubernetes.io/projected/e22769ed-dbfa-48f4-b8aa-2b507b691e89-kube-api-access-9vk47\") pod \"kserve-controller-manager-7598d7bb4-lwkjw\" (UID: \"e22769ed-dbfa-48f4-b8aa-2b507b691e89\") " pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.108920 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.108899 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:16:12.118295 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.118273 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") pod \"8e29bbe2-b413-4515-a739-ac5beea74172\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " Jul 07 14:16:12.118376 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.118314 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hxwp\" (UniqueName: \"kubernetes.io/projected/8e29bbe2-b413-4515-a739-ac5beea74172-kube-api-access-5hxwp\") pod \"8e29bbe2-b413-4515-a739-ac5beea74172\" (UID: \"8e29bbe2-b413-4515-a739-ac5beea74172\") " Jul 07 14:16:12.120334 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.120312 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert" (OuterVolumeSpecName: "cert") pod "8e29bbe2-b413-4515-a739-ac5beea74172" (UID: "8e29bbe2-b413-4515-a739-ac5beea74172"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:16:12.120434 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.120353 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e29bbe2-b413-4515-a739-ac5beea74172-kube-api-access-5hxwp" (OuterVolumeSpecName: "kube-api-access-5hxwp") pod "8e29bbe2-b413-4515-a739-ac5beea74172" (UID: "8e29bbe2-b413-4515-a739-ac5beea74172"). InnerVolumeSpecName "kube-api-access-5hxwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:16:12.218965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.218931 2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e29bbe2-b413-4515-a739-ac5beea74172-cert\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:16:12.218965 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.218964 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hxwp\" (UniqueName: \"kubernetes.io/projected/8e29bbe2-b413-4515-a739-ac5beea74172-kube-api-access-5hxwp\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:16:12.266579 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.266547 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.394479 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.394447 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-lwkjw"] Jul 07 14:16:12.397500 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:16:12.397474 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22769ed_dbfa_48f4_b8aa_2b507b691e89.slice/crio-b5d098afc9b67092d7a2c79fa25be190146ee23a23d5f388e156452c5c6c77c2 WatchSource:0}: Error finding container b5d098afc9b67092d7a2c79fa25be190146ee23a23d5f388e156452c5c6c77c2: Status 404 returned error can't find the container with id b5d098afc9b67092d7a2c79fa25be190146ee23a23d5f388e156452c5c6c77c2 Jul 07 14:16:12.937975 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.937929 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" event={"ID":"e22769ed-dbfa-48f4-b8aa-2b507b691e89","Type":"ContainerStarted","Data":"fbb0b1d5a8702bbdd57c191906f5aa8a0404c438fbcd7b22be14bc31743e196b"} Jul 07 14:16:12.938447 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.937996 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" event={"ID":"e22769ed-dbfa-48f4-b8aa-2b507b691e89","Type":"ContainerStarted","Data":"b5d098afc9b67092d7a2c79fa25be190146ee23a23d5f388e156452c5c6c77c2"} Jul 07 14:16:12.938447 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.938026 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:12.939194 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.939166 2569 generic.go:356] "Generic (PLEG): container finished" podID="8e29bbe2-b413-4515-a739-ac5beea74172" containerID="938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7" exitCode=0 Jul 07 14:16:12.939340 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.939199 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" event={"ID":"8e29bbe2-b413-4515-a739-ac5beea74172","Type":"ContainerDied","Data":"938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7"} Jul 07 14:16:12.939340 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.939273 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" event={"ID":"8e29bbe2-b413-4515-a739-ac5beea74172","Type":"ContainerDied","Data":"a7e0d38678427a5b009539643a9102b89c13d800ed5d672c31da9e62ead45a68"} Jul 07 14:16:12.939340 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.939296 2569 scope.go:117] "RemoveContainer" containerID="938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7" Jul 07 14:16:12.939340 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.939210 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7598d7bb4-dn9k4" Jul 07 14:16:12.947667 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.947651 2569 scope.go:117] "RemoveContainer" containerID="938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7" Jul 07 14:16:12.947954 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:16:12.947933 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7\": container with ID starting with 938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7 not found: ID does not exist" containerID="938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7" Jul 07 14:16:12.948001 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.947965 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7"} err="failed to get container status \"938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7\": rpc error: code = NotFound desc = could not find container \"938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7\": container with ID starting with 938ddeccee800b26a92d36014a89f46f84072916bbd66784b57545d30305a1e7 not found: ID does not exist" Jul 07 14:16:12.955410 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.955371 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" podStartSLOduration=1.644838659 podStartE2EDuration="1.955356334s" totalImagesPullingTime="310.517675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:12.954451213 +0000 UTC m=+380.308722940" watchObservedRunningTime="2026-07-07 14:16:12.955356334 +0000 UTC m=+380.309628060" Jul 07 14:16:12.969279 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.969211 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-dn9k4"] Jul 07 14:16:12.972495 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:12.972475 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7598d7bb4-dn9k4"] Jul 07 14:16:13.231109 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:13.231023 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e29bbe2-b413-4515-a739-ac5beea74172" path="/var/lib/kubelet/pods/8e29bbe2-b413-4515-a739-ac5beea74172/volumes" Jul 07 14:16:43.948239 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:43.948196 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7598d7bb4-lwkjw" Jul 07 14:16:50.637063 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.637030 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cf95c5bcc-6zrrm"] Jul 07 14:16:50.637463 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.637389 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e29bbe2-b413-4515-a739-ac5beea74172" containerName="manager" Jul 07 14:16:50.637463 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.637402 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e29bbe2-b413-4515-a739-ac5beea74172" containerName="manager" Jul 07 14:16:50.637540 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.637478 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e29bbe2-b413-4515-a739-ac5beea74172" containerName="manager" Jul 07 14:16:50.639600 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.639582 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.662968 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.662940 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf95c5bcc-6zrrm"] Jul 07 14:16:50.729422 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729387 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-oauth-serving-cert\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.729422 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-oauth-config\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.729627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729444 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-service-ca\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.729627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729467 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2d25\" (UniqueName: \"kubernetes.io/projected/8876ccee-878f-49b3-ae0e-8f72c5a226da-kube-api-access-t2d25\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.729627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729529 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-trusted-ca-bundle\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.729627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-config\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.729767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.729630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-serving-cert\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.830715 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.830672 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-oauth-serving-cert\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.830715 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.830718 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-oauth-config\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.830927 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.830750 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-service-ca\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.830927 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.830785 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2d25\" (UniqueName: \"kubernetes.io/projected/8876ccee-878f-49b3-ae0e-8f72c5a226da-kube-api-access-t2d25\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831003 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.830921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-trusted-ca-bundle\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831095 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.831075 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-config\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831159 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.831120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-serving-cert\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.831569 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-oauth-serving-cert\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.831593 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-service-ca\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831847 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.831820 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-config\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.831903 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.831832 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8876ccee-878f-49b3-ae0e-8f72c5a226da-trusted-ca-bundle\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.833319 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.833298 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-oauth-config\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.833418 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.833397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8876ccee-878f-49b3-ae0e-8f72c5a226da-console-serving-cert\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.844997 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.844973 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2d25\" (UniqueName: \"kubernetes.io/projected/8876ccee-878f-49b3-ae0e-8f72c5a226da-kube-api-access-t2d25\") pod \"console-5cf95c5bcc-6zrrm\" (UID: \"8876ccee-878f-49b3-ae0e-8f72c5a226da\") " pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:50.948558 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:50.948526 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:16:51.093122 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:51.090458 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf95c5bcc-6zrrm"] Jul 07 14:16:52.095343 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:52.095305 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf95c5bcc-6zrrm" event={"ID":"8876ccee-878f-49b3-ae0e-8f72c5a226da","Type":"ContainerStarted","Data":"f743cd042c74c740b9b9172a0087a31b9f2d851000ae2e6e6c2f954f135335ee"} Jul 07 14:16:52.095737 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:52.095356 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf95c5bcc-6zrrm" event={"ID":"8876ccee-878f-49b3-ae0e-8f72c5a226da","Type":"ContainerStarted","Data":"5ec83257db7ee03dd41727bf6f86a96652fb20c4a2f593421697eba9975d5b8c"} Jul 07 14:16:52.117979 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:16:52.117932 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cf95c5bcc-6zrrm" podStartSLOduration=2.117917369 podStartE2EDuration="2.117917369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:52.116388255 +0000 UTC m=+419.470659982" watchObservedRunningTime="2026-07-07 14:16:52.117917369 +0000 UTC m=+419.472189094" Jul 07 14:17:00.949119 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:00.949073 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:17:00.949547 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:00.949158 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:17:00.954030 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:00.954005 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:17:01.133874 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:01.133846 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cf95c5bcc-6zrrm" Jul 07 14:17:01.196816 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:01.196782 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfdcfb88d-pnzvh"] Jul 07 14:17:26.220088 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.219977 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5dfdcfb88d-pnzvh" podUID="ed165be4-e551-429d-9bf1-d79d96df19a6" containerName="console" containerID="cri-o://d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f" gracePeriod=15 Jul 07 14:17:26.458369 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.458341 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:17:26.542849 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542749 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-trusted-ca-bundle\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.542849 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542813 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcgmw\" (UniqueName: \"kubernetes.io/projected/ed165be4-e551-429d-9bf1-d79d96df19a6-kube-api-access-rcgmw\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.542849 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542842 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-service-ca\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.543120 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542863 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-serving-cert\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.543120 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542894 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-oauth-serving-cert\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.543120 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542920 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-oauth-config\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.543120 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.542951 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-console-config\") pod \"ed165be4-e551-429d-9bf1-d79d96df19a6\" (UID: \"ed165be4-e551-429d-9bf1-d79d96df19a6\") " Jul 07 14:17:26.543403 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.543370 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:17:26.543475 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.543380 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:17:26.543475 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.543449 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-console-config" (OuterVolumeSpecName: "console-config") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:17:26.543475 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.543463 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:17:26.545049 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.545031 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed165be4-e551-429d-9bf1-d79d96df19a6-kube-api-access-rcgmw" (OuterVolumeSpecName: "kube-api-access-rcgmw") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "kube-api-access-rcgmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:17:26.545517 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.545482 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:17:26.545517 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.545499 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed165be4-e551-429d-9bf1-d79d96df19a6" (UID: "ed165be4-e551-429d-9bf1-d79d96df19a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:17:26.643767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643725 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcgmw\" (UniqueName: \"kubernetes.io/projected/ed165be4-e551-429d-9bf1-d79d96df19a6-kube-api-access-rcgmw\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:26.643767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643759 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-service-ca\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:26.643767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643769 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-serving-cert\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:26.643767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643777 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-oauth-serving-cert\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:26.644033 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643786 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed165be4-e551-429d-9bf1-d79d96df19a6-console-oauth-config\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:26.644033 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643794 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-console-config\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:26.644033 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:26.643804 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed165be4-e551-429d-9bf1-d79d96df19a6-trusted-ca-bundle\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:17:27.228117 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.228081 2569 generic.go:356] "Generic (PLEG): container finished" podID="ed165be4-e551-429d-9bf1-d79d96df19a6" containerID="d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f" exitCode=0 Jul 07 14:17:27.228519 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.228172 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdcfb88d-pnzvh" Jul 07 14:17:27.229699 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.229677 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdcfb88d-pnzvh" event={"ID":"ed165be4-e551-429d-9bf1-d79d96df19a6","Type":"ContainerDied","Data":"d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f"} Jul 07 14:17:27.229779 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.229719 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdcfb88d-pnzvh" event={"ID":"ed165be4-e551-429d-9bf1-d79d96df19a6","Type":"ContainerDied","Data":"af8d37ac1947842cf500fd03e2d9a3cd474a08f53d482a9723900aa3f11966e7"} Jul 07 14:17:27.229779 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.229747 2569 scope.go:117] "RemoveContainer" containerID="d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f" Jul 07 14:17:27.239509 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.239483 2569 scope.go:117] "RemoveContainer" containerID="d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f" Jul 07 14:17:27.240982 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:17:27.240953 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f\": container with ID starting with d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f not found: ID does not exist" containerID="d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f" Jul 07 14:17:27.241147 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.241120 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f"} err="failed to get container status \"d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f\": rpc error: code = NotFound desc = could not find container \"d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f\": container with ID starting with d7c8570f86bda92320bed11a2f5531917b0f3ab13e8e72168e06dbaaf60c434f not found: ID does not exist" Jul 07 14:17:27.255480 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.255453 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfdcfb88d-pnzvh"] Jul 07 14:17:27.259570 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:27.259546 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfdcfb88d-pnzvh"] Jul 07 14:17:29.230931 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:17:29.230887 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed165be4-e551-429d-9bf1-d79d96df19a6" path="/var/lib/kubelet/pods/ed165be4-e551-429d-9bf1-d79d96df19a6/volumes" Jul 07 14:19:53.066007 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:19:53.065975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:19:53.067046 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:19:53.067017 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:19:53.069666 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:19:53.069639 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:19:53.070638 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:19:53.070617 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:22:08.870739 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.870657 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9"] Jul 07 14:22:08.871183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.870959 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed165be4-e551-429d-9bf1-d79d96df19a6" containerName="console" Jul 07 14:22:08.871183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.870971 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed165be4-e551-429d-9bf1-d79d96df19a6" containerName="console" Jul 07 14:22:08.871183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.871028 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed165be4-e551-429d-9bf1-d79d96df19a6" containerName="console" Jul 07 14:22:08.873306 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.873289 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:08.877800 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.877764 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-884de-kube-rbac-proxy-sar-config\"" Jul 07 14:22:08.878337 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.878313 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8rhzg\"" Jul 07 14:22:08.878460 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.878320 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 07 14:22:08.878586 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.878566 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-884de-serving-cert\"" Jul 07 14:22:08.895446 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.895419 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9"] Jul 07 14:22:08.915502 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.915474 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616be206-f6bc-4db5-8a4a-b72e6375b8d7-openshift-service-ca-bundle\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:08.915659 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:08.915512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:09.016519 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:09.016479 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616be206-f6bc-4db5-8a4a-b72e6375b8d7-openshift-service-ca-bundle\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:09.016519 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:09.016518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:09.016733 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:22:09.016637 2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-884de-serving-cert: secret "model-chainer-raw-884de-serving-cert" not found Jul 07 14:22:09.016733 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:22:09.016709 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls podName:616be206-f6bc-4db5-8a4a-b72e6375b8d7 nodeName:}" failed. No retries permitted until 2026-07-07 14:22:09.516692716 +0000 UTC m=+736.870964422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls") pod "model-chainer-raw-884de-5f6f5ccc9d-gjgd9" (UID: "616be206-f6bc-4db5-8a4a-b72e6375b8d7") : secret "model-chainer-raw-884de-serving-cert" not found Jul 07 14:22:09.017287 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:09.017268 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616be206-f6bc-4db5-8a4a-b72e6375b8d7-openshift-service-ca-bundle\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:09.521464 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:09.521422 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:09.521665 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:22:09.521538 2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-884de-serving-cert: secret "model-chainer-raw-884de-serving-cert" not found Jul 07 14:22:09.521665 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:22:09.521590 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls podName:616be206-f6bc-4db5-8a4a-b72e6375b8d7 nodeName:}" failed. No retries permitted until 2026-07-07 14:22:10.521576528 +0000 UTC m=+737.875848233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls") pod "model-chainer-raw-884de-5f6f5ccc9d-gjgd9" (UID: "616be206-f6bc-4db5-8a4a-b72e6375b8d7") : secret "model-chainer-raw-884de-serving-cert" not found Jul 07 14:22:10.532855 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:10.532814 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:10.535250 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:10.535203 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") pod \"model-chainer-raw-884de-5f6f5ccc9d-gjgd9\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:10.683336 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:10.683295 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:10.818793 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:10.818766 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9"] Jul 07 14:22:10.820883 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:22:10.820857 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616be206_f6bc_4db5_8a4a_b72e6375b8d7.slice/crio-207802f77fe3aaf5a8dcbd2b1643729a4f963b5ffcc0f07116eb13d582c75618 WatchSource:0}: Error finding container 207802f77fe3aaf5a8dcbd2b1643729a4f963b5ffcc0f07116eb13d582c75618: Status 404 returned error can't find the container with id 207802f77fe3aaf5a8dcbd2b1643729a4f963b5ffcc0f07116eb13d582c75618 Jul 07 14:22:10.822701 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:10.822680 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:22:11.311053 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:11.311008 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" event={"ID":"616be206-f6bc-4db5-8a4a-b72e6375b8d7","Type":"ContainerStarted","Data":"207802f77fe3aaf5a8dcbd2b1643729a4f963b5ffcc0f07116eb13d582c75618"} Jul 07 14:22:13.319526 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:13.319490 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" event={"ID":"616be206-f6bc-4db5-8a4a-b72e6375b8d7","Type":"ContainerStarted","Data":"f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf"} Jul 07 14:22:13.319953 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:13.319633 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:13.340531 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:13.340477 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podStartSLOduration=2.965616192 podStartE2EDuration="5.340461573s" totalImagesPullingTime="2.374845381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:22:13.33825734 +0000 UTC m=+740.692529100" watchObservedRunningTime="2026-07-07 14:22:13.340461573 +0000 UTC m=+740.694733301" Jul 07 14:22:18.908000 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:18.907965 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9"] Jul 07 14:22:18.908627 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:18.908169 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" containerID="cri-o://f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf" gracePeriod=30 Jul 07 14:22:18.915904 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:18.915863 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:22:23.912467 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:23.912419 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:22:28.912485 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:28.912435 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:22:33.912143 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:33.912102 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:22:38.912181 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:38.912129 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:22:43.912866 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:43.912818 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:22:48.912321 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:48.912204 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" probeResult="failure" output="Get \"https://10.133.0.26:8080/readyz\": dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:22:49.096819 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.096791 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:49.170815 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.170732 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616be206-f6bc-4db5-8a4a-b72e6375b8d7-openshift-service-ca-bundle\") pod \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " Jul 07 14:22:49.170815 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.170768 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") pod \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\" (UID: \"616be206-f6bc-4db5-8a4a-b72e6375b8d7\") " Jul 07 14:22:49.171117 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.171083 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616be206-f6bc-4db5-8a4a-b72e6375b8d7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "616be206-f6bc-4db5-8a4a-b72e6375b8d7" (UID: "616be206-f6bc-4db5-8a4a-b72e6375b8d7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:22:49.172980 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.172955 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "616be206-f6bc-4db5-8a4a-b72e6375b8d7" (UID: "616be206-f6bc-4db5-8a4a-b72e6375b8d7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:22:49.271617 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.271576 2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616be206-f6bc-4db5-8a4a-b72e6375b8d7-openshift-service-ca-bundle\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:22:49.271617 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.271604 2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/616be206-f6bc-4db5-8a4a-b72e6375b8d7-proxy-tls\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:22:49.459765 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.459730 2569 generic.go:356] "Generic (PLEG): container finished" podID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerID="f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf" exitCode=0 Jul 07 14:22:49.459955 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.459781 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" Jul 07 14:22:49.459955 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.459779 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" event={"ID":"616be206-f6bc-4db5-8a4a-b72e6375b8d7","Type":"ContainerDied","Data":"f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf"} Jul 07 14:22:49.459955 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.459908 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9" event={"ID":"616be206-f6bc-4db5-8a4a-b72e6375b8d7","Type":"ContainerDied","Data":"207802f77fe3aaf5a8dcbd2b1643729a4f963b5ffcc0f07116eb13d582c75618"} Jul 07 14:22:49.459955 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.459940 2569 scope.go:117] "RemoveContainer" containerID="f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf" Jul 07 14:22:49.467930 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.467913 2569 scope.go:117] "RemoveContainer" containerID="f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf" Jul 07 14:22:49.468202 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:22:49.468184 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf\": container with ID starting with f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf not found: ID does not exist" containerID="f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf" Jul 07 14:22:49.468269 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.468212 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf"} err="failed to get container status \"f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf\": rpc error: code = NotFound desc = could not find container \"f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf\": container with ID starting with f085ca2a8ce544673e54f0eee44b7e0e7a35324a9e178c7189b4eb32027c9faf not found: ID does not exist" Jul 07 14:22:49.479248 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.479199 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9"] Jul 07 14:22:49.484082 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:49.484057 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-884de-5f6f5ccc9d-gjgd9"] Jul 07 14:22:51.230238 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:22:51.230203 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" path="/var/lib/kubelet/pods/616be206-f6bc-4db5-8a4a-b72e6375b8d7/volumes" Jul 07 14:23:59.188304 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.188263 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz"] Jul 07 14:23:59.188772 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.188612 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" Jul 07 14:23:59.188772 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.188624 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" Jul 07 14:23:59.188772 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.188676 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="616be206-f6bc-4db5-8a4a-b72e6375b8d7" containerName="model-chainer-raw-884de" Jul 07 14:23:59.191612 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.191591 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.193579 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.193554 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8rhzg\"" Jul 07 14:23:59.193767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.193720 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-bd33a-kube-rbac-proxy-sar-config\"" Jul 07 14:23:59.193767 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.193755 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-bd33a-serving-cert\"" Jul 07 14:23:59.193898 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.193781 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 07 14:23:59.201525 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.201497 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz"] Jul 07 14:23:59.281110 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.281072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6bb16c97-eedf-4179-b199-4d47dee94551-proxy-tls\") pod \"model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.281315 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.281216 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb16c97-eedf-4179-b199-4d47dee94551-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.382689 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.382651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6bb16c97-eedf-4179-b199-4d47dee94551-proxy-tls\") pod \"model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.382899 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.382718 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb16c97-eedf-4179-b199-4d47dee94551-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.383348 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.383328 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb16c97-eedf-4179-b199-4d47dee94551-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.385194 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.385176 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6bb16c97-eedf-4179-b199-4d47dee94551-proxy-tls\") pod \"model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.502731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.502627 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.633591 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.633564 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz"] Jul 07 14:23:59.636256 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:23:59.636211 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb16c97_eedf_4179_b199_4d47dee94551.slice/crio-9c2aacf4280cd39f024e1988639ecfafc1414a1030c39d5f957b136d8a3d7aa7 WatchSource:0}: Error finding container 9c2aacf4280cd39f024e1988639ecfafc1414a1030c39d5f957b136d8a3d7aa7: Status 404 returned error can't find the container with id 9c2aacf4280cd39f024e1988639ecfafc1414a1030c39d5f957b136d8a3d7aa7 Jul 07 14:23:59.735888 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.735854 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" event={"ID":"6bb16c97-eedf-4179-b199-4d47dee94551","Type":"ContainerStarted","Data":"df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb"} Jul 07 14:23:59.736070 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.735910 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" event={"ID":"6bb16c97-eedf-4179-b199-4d47dee94551","Type":"ContainerStarted","Data":"9c2aacf4280cd39f024e1988639ecfafc1414a1030c39d5f957b136d8a3d7aa7"} Jul 07 14:23:59.736070 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.735949 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:23:59.753051 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:23:59.752941 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podStartSLOduration=0.752924559 podStartE2EDuration="752.924559ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:23:59.75132354 +0000 UTC m=+847.105595284" watchObservedRunningTime="2026-07-07 14:23:59.752924559 +0000 UTC m=+847.107196285" Jul 07 14:24:05.746751 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:05.746720 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:24:09.257018 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.256975 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz"] Jul 07 14:24:09.257562 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.257221 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" containerID="cri-o://df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb" gracePeriod=30 Jul 07 14:24:09.458962 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.458910 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv"] Jul 07 14:24:09.463113 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.463089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.464955 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.464928 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-7a71c-predictor-serving-cert\"" Jul 07 14:24:09.465077 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.465057 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 07 14:24:09.465311 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.465292 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-7a71c-kube-rbac-proxy-sar-config\"" Jul 07 14:24:09.473845 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.473822 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv"] Jul 07 14:24:09.567837 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.567748 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mfc5\" (UniqueName: \"kubernetes.io/projected/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-api-access-4mfc5\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.567837 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.567790 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.568022 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.567868 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e9de898-2676-403c-93b6-dcdc93af1c6c-proxy-tls\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.668993 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.668962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mfc5\" (UniqueName: \"kubernetes.io/projected/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-api-access-4mfc5\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.669155 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.669001 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.669155 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.669036 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e9de898-2676-403c-93b6-dcdc93af1c6c-proxy-tls\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.669711 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.669681 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.671657 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.671627 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e9de898-2676-403c-93b6-dcdc93af1c6c-proxy-tls\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.678268 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.678247 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mfc5\" (UniqueName: \"kubernetes.io/projected/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-api-access-4mfc5\") pod \"message-dumper-raw-7a71c-predictor-d86df68f-qtdkv\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.773757 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.773722 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:09.911757 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:09.911708 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv"] Jul 07 14:24:09.917959 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:24:09.917929 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9de898_2676_403c_93b6_dcdc93af1c6c.slice/crio-08fb78620158c3db5774e53408659d5942c2a825328e0848dfec8b85f6174d29 WatchSource:0}: Error finding container 08fb78620158c3db5774e53408659d5942c2a825328e0848dfec8b85f6174d29: Status 404 returned error can't find the container with id 08fb78620158c3db5774e53408659d5942c2a825328e0848dfec8b85f6174d29 Jul 07 14:24:10.746037 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:10.745992 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:24:10.782961 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:10.782920 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" event={"ID":"0e9de898-2676-403c-93b6-dcdc93af1c6c","Type":"ContainerStarted","Data":"08fb78620158c3db5774e53408659d5942c2a825328e0848dfec8b85f6174d29"} Jul 07 14:24:11.788808 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:11.788776 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" event={"ID":"0e9de898-2676-403c-93b6-dcdc93af1c6c","Type":"ContainerStarted","Data":"abf423fd319922fd7fc5040503295d8d1745eba8746ef5703996a541ce4fad2e"} Jul 07 14:24:14.807981 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:14.807944 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" event={"ID":"0e9de898-2676-403c-93b6-dcdc93af1c6c","Type":"ContainerStarted","Data":"cae4e428f5c940152e772d50fa72a7079604c637d7f86d14116a61b824f4145e"} Jul 07 14:24:14.808471 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:14.808149 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:14.808471 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:14.808292 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:14.810044 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:14.810024 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:14.827569 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:14.827496 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" podStartSLOduration=2.052262139 podStartE2EDuration="5.827480372s" totalImagesPullingTime="3.775218233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:14.825989113 +0000 UTC m=+862.180260858" watchObservedRunningTime="2026-07-07 14:24:14.827480372 +0000 UTC m=+862.181752098" Jul 07 14:24:15.744522 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:15.744481 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:24:20.745000 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:20.744951 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:24:20.745497 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:20.745057 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:24:21.822118 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:21.822091 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:24:25.745392 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:25.745351 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:24:30.745177 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:30.745134 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:24:35.745219 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:35.745170 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:24:39.418383 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.418349 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:24:39.514729 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.514612 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb16c97-eedf-4179-b199-4d47dee94551-openshift-service-ca-bundle\") pod \"6bb16c97-eedf-4179-b199-4d47dee94551\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " Jul 07 14:24:39.514729 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.514682 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6bb16c97-eedf-4179-b199-4d47dee94551-proxy-tls\") pod \"6bb16c97-eedf-4179-b199-4d47dee94551\" (UID: \"6bb16c97-eedf-4179-b199-4d47dee94551\") " Jul 07 14:24:39.515028 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.515003 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb16c97-eedf-4179-b199-4d47dee94551-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6bb16c97-eedf-4179-b199-4d47dee94551" (UID: "6bb16c97-eedf-4179-b199-4d47dee94551"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:24:39.516693 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.516674 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb16c97-eedf-4179-b199-4d47dee94551-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6bb16c97-eedf-4179-b199-4d47dee94551" (UID: "6bb16c97-eedf-4179-b199-4d47dee94551"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:24:39.615596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.615548 2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb16c97-eedf-4179-b199-4d47dee94551-openshift-service-ca-bundle\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:24:39.615596 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.615589 2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6bb16c97-eedf-4179-b199-4d47dee94551-proxy-tls\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:24:39.908501 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.908409 2569 generic.go:356] "Generic (PLEG): container finished" podID="6bb16c97-eedf-4179-b199-4d47dee94551" containerID="df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb" exitCode=0 Jul 07 14:24:39.908501 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.908456 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" Jul 07 14:24:39.908501 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.908491 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" event={"ID":"6bb16c97-eedf-4179-b199-4d47dee94551","Type":"ContainerDied","Data":"df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb"} Jul 07 14:24:39.908731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.908564 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz" event={"ID":"6bb16c97-eedf-4179-b199-4d47dee94551","Type":"ContainerDied","Data":"9c2aacf4280cd39f024e1988639ecfafc1414a1030c39d5f957b136d8a3d7aa7"} Jul 07 14:24:39.908731 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.908585 2569 scope.go:117] "RemoveContainer" containerID="df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb" Jul 07 14:24:39.916801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.916783 2569 scope.go:117] "RemoveContainer" containerID="df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb" Jul 07 14:24:39.917064 ip-10-0-139-136 kubenswrapper[2569]: E0707 14:24:39.917044 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb\": container with ID starting with df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb not found: ID does not exist" containerID="df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb" Jul 07 14:24:39.917127 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.917070 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb"} err="failed to get container status \"df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb\": rpc error: code = NotFound desc = could not find container \"df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb\": container with ID starting with df7e4f88421795d5e77d32d23a7833f8ddf2a762e8d0ea43a11b7d917445d9fb not found: ID does not exist" Jul 07 14:24:39.927584 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.927556 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz"] Jul 07 14:24:39.929707 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:39.929688 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd33a-64d55c4c48-8w8pz"] Jul 07 14:24:41.231008 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:41.230962 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" path="/var/lib/kubelet/pods/6bb16c97-eedf-4179-b199-4d47dee94551/volumes" Jul 07 14:24:53.091453 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:53.091374 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:24:53.091849 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:53.091808 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:24:53.094709 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:53.094689 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:24:53.095162 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:24:53.095140 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:26:04.508690 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:04.508660 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-raw-7a71c-predictor-d86df68f-qtdkv_0e9de898-2676-403c-93b6-dcdc93af1c6c/kserve-container/0.log" Jul 07 14:26:05.044335 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.044291 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv"] Jul 07 14:26:05.044623 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.044591 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kserve-container" containerID="cri-o://abf423fd319922fd7fc5040503295d8d1745eba8746ef5703996a541ce4fad2e" gracePeriod=30 Jul 07 14:26:05.044713 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.044638 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kube-rbac-proxy" containerID="cri-o://cae4e428f5c940152e772d50fa72a7079604c637d7f86d14116a61b824f4145e" gracePeriod=30 Jul 07 14:26:05.253412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.253377 2569 generic.go:356] "Generic (PLEG): container finished" podID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerID="cae4e428f5c940152e772d50fa72a7079604c637d7f86d14116a61b824f4145e" exitCode=2 Jul 07 14:26:05.253412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.253404 2569 generic.go:356] "Generic (PLEG): container finished" podID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerID="abf423fd319922fd7fc5040503295d8d1745eba8746ef5703996a541ce4fad2e" exitCode=2 Jul 07 14:26:05.253412 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.253430 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" event={"ID":"0e9de898-2676-403c-93b6-dcdc93af1c6c","Type":"ContainerDied","Data":"cae4e428f5c940152e772d50fa72a7079604c637d7f86d14116a61b824f4145e"} Jul 07 14:26:05.253729 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.253474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" event={"ID":"0e9de898-2676-403c-93b6-dcdc93af1c6c","Type":"ContainerDied","Data":"abf423fd319922fd7fc5040503295d8d1745eba8746ef5703996a541ce4fad2e"} Jul 07 14:26:05.303671 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.303602 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:26:05.431129 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.431094 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mfc5\" (UniqueName: \"kubernetes.io/projected/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-api-access-4mfc5\") pod \"0e9de898-2676-403c-93b6-dcdc93af1c6c\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " Jul 07 14:26:05.431329 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.431147 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-rbac-proxy-sar-config\") pod \"0e9de898-2676-403c-93b6-dcdc93af1c6c\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " Jul 07 14:26:05.431329 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.431184 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e9de898-2676-403c-93b6-dcdc93af1c6c-proxy-tls\") pod \"0e9de898-2676-403c-93b6-dcdc93af1c6c\" (UID: \"0e9de898-2676-403c-93b6-dcdc93af1c6c\") " Jul 07 14:26:05.431574 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.431543 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0e9de898-2676-403c-93b6-dcdc93af1c6c" (UID: "0e9de898-2676-403c-93b6-dcdc93af1c6c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:26:05.433178 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.433157 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e9de898-2676-403c-93b6-dcdc93af1c6c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0e9de898-2676-403c-93b6-dcdc93af1c6c" (UID: "0e9de898-2676-403c-93b6-dcdc93af1c6c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:26:05.433286 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.433215 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-api-access-4mfc5" (OuterVolumeSpecName: "kube-api-access-4mfc5") pod "0e9de898-2676-403c-93b6-dcdc93af1c6c" (UID: "0e9de898-2676-403c-93b6-dcdc93af1c6c"). InnerVolumeSpecName "kube-api-access-4mfc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:26:05.532183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.532147 2569 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:26:05.532183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.532178 2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e9de898-2676-403c-93b6-dcdc93af1c6c-proxy-tls\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:26:05.532183 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:05.532187 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mfc5\" (UniqueName: \"kubernetes.io/projected/0e9de898-2676-403c-93b6-dcdc93af1c6c-kube-api-access-4mfc5\") on node \"ip-10-0-139-136.ec2.internal\" DevicePath \"\"" Jul 07 14:26:06.258549 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:06.258522 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" Jul 07 14:26:06.258549 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:06.258541 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv" event={"ID":"0e9de898-2676-403c-93b6-dcdc93af1c6c","Type":"ContainerDied","Data":"08fb78620158c3db5774e53408659d5942c2a825328e0848dfec8b85f6174d29"} Jul 07 14:26:06.258801 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:06.258604 2569 scope.go:117] "RemoveContainer" containerID="cae4e428f5c940152e772d50fa72a7079604c637d7f86d14116a61b824f4145e" Jul 07 14:26:06.267453 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:06.267436 2569 scope.go:117] "RemoveContainer" containerID="abf423fd319922fd7fc5040503295d8d1745eba8746ef5703996a541ce4fad2e" Jul 07 14:26:06.280516 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:06.280491 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv"] Jul 07 14:26:06.284780 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:06.284759 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7a71c-predictor-d86df68f-qtdkv"] Jul 07 14:26:07.230462 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:26:07.230428 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" path="/var/lib/kubelet/pods/0e9de898-2676-403c-93b6-dcdc93af1c6c/volumes" Jul 07 14:29:53.115350 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:29:53.115312 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:29:53.117242 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:29:53.117213 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:29:53.119178 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:29:53.119161 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:29:53.121023 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:29:53.121002 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:34:39.159381 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159345 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x5hr6/must-gather-5t4dc"] Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159652 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159664 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159674 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kube-rbac-proxy" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159679 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kube-rbac-proxy" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159692 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kserve-container" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159697 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kserve-container" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159752 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kserve-container" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159761 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9de898-2676-403c-93b6-dcdc93af1c6c" containerName="kube-rbac-proxy" Jul 07 14:34:39.159857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.159770 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb16c97-eedf-4179-b199-4d47dee94551" containerName="model-chainer-raw-hpa-bd33a" Jul 07 14:34:39.162685 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.162666 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.165474 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.165450 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x5hr6\"/\"default-dockercfg-kkxpj\"" Jul 07 14:34:39.165661 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.165451 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x5hr6\"/\"kube-root-ca.crt\"" Jul 07 14:34:39.165661 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.165488 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x5hr6\"/\"openshift-service-ca.crt\"" Jul 07 14:34:39.171905 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.171882 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x5hr6/must-gather-5t4dc"] Jul 07 14:34:39.181357 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.181324 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v9lx\" (UniqueName: \"kubernetes.io/projected/30a88846-9d09-40f4-89a2-43308c9db7d9-kube-api-access-8v9lx\") pod \"must-gather-5t4dc\" (UID: \"30a88846-9d09-40f4-89a2-43308c9db7d9\") " pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.181501 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.181469 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30a88846-9d09-40f4-89a2-43308c9db7d9-must-gather-output\") pod \"must-gather-5t4dc\" (UID: \"30a88846-9d09-40f4-89a2-43308c9db7d9\") " pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.282868 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.282826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30a88846-9d09-40f4-89a2-43308c9db7d9-must-gather-output\") pod \"must-gather-5t4dc\" (UID: \"30a88846-9d09-40f4-89a2-43308c9db7d9\") " pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.283095 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.283068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v9lx\" (UniqueName: \"kubernetes.io/projected/30a88846-9d09-40f4-89a2-43308c9db7d9-kube-api-access-8v9lx\") pod \"must-gather-5t4dc\" (UID: \"30a88846-9d09-40f4-89a2-43308c9db7d9\") " pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.283221 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.283199 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30a88846-9d09-40f4-89a2-43308c9db7d9-must-gather-output\") pod \"must-gather-5t4dc\" (UID: \"30a88846-9d09-40f4-89a2-43308c9db7d9\") " pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.292050 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.292026 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v9lx\" (UniqueName: \"kubernetes.io/projected/30a88846-9d09-40f4-89a2-43308c9db7d9-kube-api-access-8v9lx\") pod \"must-gather-5t4dc\" (UID: \"30a88846-9d09-40f4-89a2-43308c9db7d9\") " pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.472961 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.472924 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x5hr6/must-gather-5t4dc" Jul 07 14:34:39.616198 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.616152 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x5hr6/must-gather-5t4dc"] Jul 07 14:34:39.619184 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:34:39.619157 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30a88846_9d09_40f4_89a2_43308c9db7d9.slice/crio-3427b189ec1ca3912bcbf69c3af0e15874726cbe1280562ed6ff70b1fdcb1c48 WatchSource:0}: Error finding container 3427b189ec1ca3912bcbf69c3af0e15874726cbe1280562ed6ff70b1fdcb1c48: Status 404 returned error can't find the container with id 3427b189ec1ca3912bcbf69c3af0e15874726cbe1280562ed6ff70b1fdcb1c48 Jul 07 14:34:39.620975 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:39.620960 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:34:40.229707 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:40.229671 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x5hr6/must-gather-5t4dc" event={"ID":"30a88846-9d09-40f4-89a2-43308c9db7d9","Type":"ContainerStarted","Data":"3427b189ec1ca3912bcbf69c3af0e15874726cbe1280562ed6ff70b1fdcb1c48"} Jul 07 14:34:41.237754 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:41.237710 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x5hr6/must-gather-5t4dc" event={"ID":"30a88846-9d09-40f4-89a2-43308c9db7d9","Type":"ContainerStarted","Data":"c31f8e78b109a8d42c9dcbd1e70c9b1c4f677853ed2d04c53a15dfb7da8708b5"} Jul 07 14:34:41.238163 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:41.237764 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x5hr6/must-gather-5t4dc" event={"ID":"30a88846-9d09-40f4-89a2-43308c9db7d9","Type":"ContainerStarted","Data":"f1df0f4242fdb30f193a6df4705eac0558bd42fe6dd3caf6c5b8c45f6b6371d4"} Jul 07 14:34:41.256355 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:41.256276 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x5hr6/must-gather-5t4dc" podStartSLOduration=1.377645459 podStartE2EDuration="2.256258934s" totalImagesPullingTime="878.613475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:41.255977344 +0000 UTC m=+1488.610249094" watchObservedRunningTime="2026-07-07 14:34:41.256258934 +0000 UTC m=+1488.610530663" Jul 07 14:34:42.185626 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:42.185596 2569 ???:1] "http: TLS handshake error from 10.0.140.100:50016: EOF" Jul 07 14:34:42.189591 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:42.189564 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w2vcd_e574e5d9-ef9f-433d-81e0-5d1c7f2976da/global-pull-secret-syncer/0.log" Jul 07 14:34:42.328181 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:42.328127 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zwsh4_9c5c0759-27a4-482e-bfbd-2a5b06d655f6/konnectivity-agent/0.log" Jul 07 14:34:42.352201 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:42.352144 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-136.ec2.internal_f72cea69e8c4942c5863ad7b63bdf4e3/haproxy/0.log" Jul 07 14:34:46.553178 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.553145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/alertmanager/0.log" Jul 07 14:34:46.594191 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.594148 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/config-reloader/0.log" Jul 07 14:34:46.630616 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.630587 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/kube-rbac-proxy-web/0.log" Jul 07 14:34:46.666145 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.666109 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/kube-rbac-proxy/0.log" Jul 07 14:34:46.697957 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.697928 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/kube-rbac-proxy-metric/0.log" Jul 07 14:34:46.734175 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.734090 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/prom-label-proxy/0.log" Jul 07 14:34:46.765864 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.765827 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df2aeeb-bdf6-44e4-aca9-50b23c70bfe1/init-config-reloader/0.log" Jul 07 14:34:46.964994 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.964964 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-df759f9c9-l9hlj_3636bb60-9378-49c2-977f-ed0b355f5ace/metrics-server/0.log" Jul 07 14:34:46.996715 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:46.996639 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-bwc8z_592b4a9c-75d6-4a0c-bd5c-d6222cb109da/monitoring-plugin/0.log" Jul 07 14:34:47.211081 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:47.211049 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hxbll_0c57c36f-f0f7-4eec-9cc1-4cb7b4911494/node-exporter/0.log" Jul 07 14:34:47.291089 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:47.290979 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hxbll_0c57c36f-f0f7-4eec-9cc1-4cb7b4911494/kube-rbac-proxy/0.log" Jul 07 14:34:47.384629 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:47.384589 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hxbll_0c57c36f-f0f7-4eec-9cc1-4cb7b4911494/init-textfile/0.log" Jul 07 14:34:48.068626 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:48.068594 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fcf894bf4-thnzj_1d482203-4dfc-4624-8ee3-c3aa9ad88636/telemeter-client/0.log" Jul 07 14:34:48.102857 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:48.102078 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fcf894bf4-thnzj_1d482203-4dfc-4624-8ee3-c3aa9ad88636/reload/0.log" Jul 07 14:34:48.141111 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:48.141078 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fcf894bf4-thnzj_1d482203-4dfc-4624-8ee3-c3aa9ad88636/kube-rbac-proxy/0.log" Jul 07 14:34:49.956064 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:49.956031 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:34:49.964685 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:49.964645 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/2.log" Jul 07 14:34:49.976059 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:49.976019 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb"] Jul 07 14:34:49.981273 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:49.981241 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:49.993837 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:49.992117 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb"] Jul 07 14:34:50.091395 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.091360 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-proc\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.091695 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.091672 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-podres\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.091867 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.091837 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-sys\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.092015 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.091999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnm6\" (UniqueName: \"kubernetes.io/projected/7edabce6-35f9-48a8-a95d-e9441f07eb74-kube-api-access-hrnm6\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.092599 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.092570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-lib-modules\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193472 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193429 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnm6\" (UniqueName: \"kubernetes.io/projected/7edabce6-35f9-48a8-a95d-e9441f07eb74-kube-api-access-hrnm6\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193681 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-lib-modules\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193681 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193540 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-proc\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193681 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193582 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-podres\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193681 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-sys\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193681 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193654 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-proc\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193926 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193701 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-sys\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193926 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193710 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-lib-modules\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.193926 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.193797 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7edabce6-35f9-48a8-a95d-e9441f07eb74-podres\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.202475 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.202443 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnm6\" (UniqueName: \"kubernetes.io/projected/7edabce6-35f9-48a8-a95d-e9441f07eb74-kube-api-access-hrnm6\") pod \"perf-node-gather-daemonset-8zjdb\" (UID: \"7edabce6-35f9-48a8-a95d-e9441f07eb74\") " pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.294806 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.294713 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:50.465257 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.465192 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb"] Jul 07 14:34:50.472962 ip-10-0-139-136 kubenswrapper[2569]: W0707 14:34:50.472927 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7edabce6_35f9_48a8_a95d_e9441f07eb74.slice/crio-0ecd79325dcde5acdc07a0f86d3f0d477e48834c0f91d3a49168ecc69f32cf31 WatchSource:0}: Error finding container 0ecd79325dcde5acdc07a0f86d3f0d477e48834c0f91d3a49168ecc69f32cf31: Status 404 returned error can't find the container with id 0ecd79325dcde5acdc07a0f86d3f0d477e48834c0f91d3a49168ecc69f32cf31 Jul 07 14:34:50.556221 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:50.556151 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cf95c5bcc-6zrrm_8876ccee-878f-49b3-ae0e-8f72c5a226da/console/0.log" Jul 07 14:34:51.295960 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:51.295928 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" event={"ID":"7edabce6-35f9-48a8-a95d-e9441f07eb74","Type":"ContainerStarted","Data":"b6c18f1e8b57fed0337bf66964ca268913439bd9d53e8e2121a650cfaa28f0ba"} Jul 07 14:34:51.296376 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:51.295977 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" event={"ID":"7edabce6-35f9-48a8-a95d-e9441f07eb74","Type":"ContainerStarted","Data":"0ecd79325dcde5acdc07a0f86d3f0d477e48834c0f91d3a49168ecc69f32cf31"} Jul 07 14:34:51.296376 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:51.296066 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:51.314026 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:51.313974 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" podStartSLOduration=2.313957269 podStartE2EDuration="2.313957269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:51.31256006 +0000 UTC m=+1498.666831807" watchObservedRunningTime="2026-07-07 14:34:51.313957269 +0000 UTC m=+1498.668228996" Jul 07 14:34:52.265252 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:52.265212 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v5m6h_2f2941d8-aa1a-4d0a-a125-4fd68741834c/dns/0.log" Jul 07 14:34:52.294274 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:52.294247 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v5m6h_2f2941d8-aa1a-4d0a-a125-4fd68741834c/kube-rbac-proxy/0.log" Jul 07 14:34:52.386338 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:52.386310 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4zpzq_8b95f843-d7a4-48c6-ad9e-c8e104a50488/dns-node-resolver/0.log" Jul 07 14:34:53.028739 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:53.028712 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2glwb_71473ade-a0c9-444c-b26f-b9c2708ea996/node-ca/0.log" Jul 07 14:34:53.149987 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:53.149946 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:34:53.150905 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:53.150881 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fcpt4_9955ca92-0fab-41a5-93a9-988ffa54ae16/console-operator/1.log" Jul 07 14:34:53.156123 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:53.156093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:34:53.158128 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:53.158103 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wbqsv_b3da611b-0250-451d-8671-b5b47d36976d/ovn-acl-logging/0.log" Jul 07 14:34:53.980540 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:53.980505 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c444f4575-q45nh_aaed9b82-1eb7-4267-bd38-19ac434260d6/router/0.log" Jul 07 14:34:54.400978 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:54.400904 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bc9f_f314389e-e332-4d14-b499-422ab1db91fb/serve-healthcheck-canary/0.log" Jul 07 14:34:55.080034 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:55.080003 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rtgw8_59ff3474-b183-4d58-960e-8df90955ec1e/kube-rbac-proxy/0.log" Jul 07 14:34:55.103215 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:55.103185 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rtgw8_59ff3474-b183-4d58-960e-8df90955ec1e/exporter/0.log" Jul 07 14:34:55.128064 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:55.128029 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rtgw8_59ff3474-b183-4d58-960e-8df90955ec1e/extractor/0.log" Jul 07 14:34:57.314049 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:57.314017 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x5hr6/perf-node-gather-daemonset-8zjdb" Jul 07 14:34:57.320760 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:34:57.320735 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7598d7bb4-lwkjw_e22769ed-dbfa-48f4-b8aa-2b507b691e89/manager/0.log" Jul 07 14:35:04.248881 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.248849 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/kube-multus-additional-cni-plugins/0.log" Jul 07 14:35:04.335472 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.335434 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/egress-router-binary-copy/0.log" Jul 07 14:35:04.399407 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.399373 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/cni-plugins/0.log" Jul 07 14:35:04.434940 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.434911 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/bond-cni-plugin/0.log" Jul 07 14:35:04.469770 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.469739 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/routeoverride-cni/0.log" Jul 07 14:35:04.515724 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.515646 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/whereabouts-cni-bincopy/0.log" Jul 07 14:35:04.543635 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.543603 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdxcs_abc642a7-6b3d-46af-ad43-b896e5231538/whereabouts-cni/0.log" Jul 07 14:35:04.940384 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:04.940355 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rxzwh_992d75fb-eccf-4470-b749-4225c8ff52f6/kube-multus/0.log" Jul 07 14:35:05.055675 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:05.055646 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dmdzd_491931ef-dad1-4f74-97b3-0580ff9abb99/network-metrics-daemon/0.log" Jul 07 14:35:05.117361 ip-10-0-139-136 kubenswrapper[2569]: I0707 14:35:05.117329 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dmdzd_491931ef-dad1-4f74-97b3-0580ff9abb99/kube-rbac-proxy/0.log"