Jul 06 15:15:09.510975 ip-10-0-129-138 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 15:15:09.510992 ip-10-0-129-138 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 15:15:09.511002 ip-10-0-129-138 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 15:15:09.511366 ip-10-0-129-138 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 15:15:19.733813 ip-10-0-129-138 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 15:15:19.733831 ip-10-0-129-138 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8a59bdb992da4e3cacce1fb46e9684dd -- Jul 06 15:17:12.074253 ip-10-0-129-138 systemd[1]: Starting Kubernetes Kubelet... Jul 06 15:17:12.452785 ip-10-0-129-138 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:17:12.452785 ip-10-0-129-138 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 15:17:12.452785 ip-10-0-129-138 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:17:12.452785 ip-10-0-129-138 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 15:17:12.452785 ip-10-0-129-138 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:17:12.454449 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.454380 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 15:17:12.458729 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458715 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:17:12.458729 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458729 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458733 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458736 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458739 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458742 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458745 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458748 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458751 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458755 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458757 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458761 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458764 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458767 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458769 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458772 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458774 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458777 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458780 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458782 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:17:12.458790 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458784 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458787 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458790 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458792 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458795 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458798 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458801 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458803 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458806 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458809 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458811 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458814 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458817 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458819 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458822 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458825 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458828 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458831 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458833 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458836 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:17:12.459243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458838 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458841 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458843 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458846 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458849 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458851 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458854 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458856 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458859 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458861 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458864 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458866 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458869 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458871 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458874 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458877 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458880 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458882 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458885 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458887 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:17:12.459709 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458890 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458893 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458895 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458898 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458901 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458904 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458906 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458908 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458911 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458913 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458916 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458919 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458921 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458924 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458926 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458929 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458931 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458934 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458936 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:17:12.460228 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458941 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458944 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458949 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458952 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458955 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458957 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458960 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458985 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458989 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458992 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458995 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.458997 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459000 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459003 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459006 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459008 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459013 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459016 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459019 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:17:12.460674 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459022 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459687 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459693 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459696 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459698 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459701 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459705 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459709 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459712 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459716 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459718 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459721 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459724 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459726 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459729 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459732 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459734 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459737 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459740 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459743 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:17:12.461131 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459747 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459749 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459752 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459754 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459757 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459760 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459762 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459765 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459767 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459770 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459772 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459775 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459778 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459781 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459784 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459786 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459789 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459791 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459793 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:17:12.461612 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459797 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459799 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459802 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459804 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459806 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459809 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459813 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459817 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459820 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459824 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459827 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459830 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459833 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459836 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459839 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459841 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459843 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459846 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459848 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:17:12.462097 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459851 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459853 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459856 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459858 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459862 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459864 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459867 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459871 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459874 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459876 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459879 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459882 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459885 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459888 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459890 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459893 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459895 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459898 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459901 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459903 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:17:12.462545 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459906 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459908 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459911 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459914 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459916 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459919 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459921 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459924 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459926 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459929 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459932 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459934 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459937 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459939 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459942 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459944 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459947 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459949 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459951 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:17:12.463038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459954 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459957 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.459959 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460319 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460324 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460327 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460336 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460339 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460342 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460344 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460346 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460349 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460352 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460354 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460357 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460359 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460362 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460365 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460368 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460370 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:17:12.463499 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460373 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460376 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460378 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460381 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460384 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460386 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460390 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460394 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460397 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460401 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460404 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460406 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460409 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460412 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460414 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460417 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460419 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460422 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460424 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:17:12.463980 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460427 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460429 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460432 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460434 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460437 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460439 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460442 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460444 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460447 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460450 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460454 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460457 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460460 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460462 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460465 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460468 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460470 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460473 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460475 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:17:12.464428 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460478 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460480 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460483 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460486 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460489 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460491 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460494 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460496 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460499 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460501 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460504 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460506 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460509 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460511 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460514 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460516 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460519 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460521 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460524 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460526 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:17:12.464896 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460528 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460531 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460534 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460537 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460540 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460542 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460545 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460547 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460550 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460554 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460557 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460560 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460563 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460565 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460569 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460574 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460577 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460579 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460582 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:17:12.465376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460585 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460587 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460591 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460594 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.460596 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460663 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460669 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460675 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460680 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460697 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460700 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460705 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460709 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460712 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460715 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460718 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460724 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460727 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460730 2579 flags.go:64] FLAG: --cgroup-root="" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460733 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460736 2579 flags.go:64] FLAG: --client-ca-file="" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460739 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460742 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460746 2579 flags.go:64] FLAG: --cluster-domain="" Jul 06 15:17:12.465839 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460749 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460752 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460755 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460758 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460763 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460766 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460769 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460773 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460775 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460778 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460781 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460784 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460787 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460791 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460794 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460797 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460800 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460803 2579 flags.go:64] FLAG: --enable-server="true" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460806 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460809 2579 flags.go:64] FLAG: --event-burst="100" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460812 2579 flags.go:64] FLAG: --event-qps="50" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460815 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460818 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460821 2579 flags.go:64] FLAG: --eviction-hard="" Jul 06 15:17:12.466412 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460826 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460829 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460832 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460835 2579 flags.go:64] FLAG: --eviction-soft="" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460838 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460841 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460844 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460847 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460849 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460852 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460855 2579 flags.go:64] FLAG: --feature-gates="" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460859 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460863 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460866 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460869 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460872 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460875 2579 flags.go:64] FLAG: --help="false" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460878 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-129-138.ec2.internal" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460881 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460884 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460892 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460896 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460899 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460902 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 15:17:12.467156 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460905 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460908 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460911 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460913 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460917 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460920 2579 flags.go:64] FLAG: --kube-reserved="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460923 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460925 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460929 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460932 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460935 2579 flags.go:64] FLAG: --lock-file="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460938 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460941 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460944 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460949 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460952 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460955 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460957 2579 flags.go:64] FLAG: --logging-format="text" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460960 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460976 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460980 2579 flags.go:64] FLAG: --manifest-url="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460983 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460987 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460990 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460994 2579 flags.go:64] FLAG: --max-pods="110" Jul 06 15:17:12.468205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.460997 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461001 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461003 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461006 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461015 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461018 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461021 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461028 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461031 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461033 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461037 2579 flags.go:64] FLAG: --pod-cidr="" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461040 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461045 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461048 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461051 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461054 2579 flags.go:64] FLAG: --port="10250" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461058 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461061 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c04b938ce0823649" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461064 2579 flags.go:64] FLAG: --qos-reserved="" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461067 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461070 2579 flags.go:64] FLAG: --register-node="true" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461073 2579 flags.go:64] FLAG: --register-with-taints="" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461076 2579 flags.go:64] FLAG: --registry-burst="10" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461079 2579 flags.go:64] FLAG: --registry-qps="5" Jul 06 15:17:12.469306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461082 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461084 2579 flags.go:64] FLAG: --reserved-memory="" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461088 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461094 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461097 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461099 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461102 2579 flags.go:64] FLAG: --runonce="false" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461105 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461108 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461111 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461114 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461117 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461120 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461128 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461132 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461134 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461137 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461140 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461143 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461146 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461149 2579 flags.go:64] FLAG: --system-cgroups="" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461152 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461157 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461160 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461164 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 15:17:12.470053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461171 2579 flags.go:64] FLAG: --tls-min-version="" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461173 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461176 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461179 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461181 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461184 2579 flags.go:64] FLAG: --v="2" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461188 2579 flags.go:64] FLAG: --version="false" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461192 2579 flags.go:64] FLAG: --vmodule="" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461196 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461199 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461335 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461339 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461342 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461345 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461349 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461353 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461355 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461358 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461361 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461363 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461365 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:17:12.470854 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461374 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461376 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461379 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461381 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461384 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461387 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461389 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461391 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461394 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461396 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461401 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461403 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461406 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461409 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461411 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461414 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461416 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461419 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461421 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461424 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:17:12.471833 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461426 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461430 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461433 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461435 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461438 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461440 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461442 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461445 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461447 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461450 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461452 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461455 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461458 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461465 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461468 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461471 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461473 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461475 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461478 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461480 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:17:12.472531 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461483 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461485 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461489 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461491 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461494 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461497 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461499 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461502 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461505 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461507 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461510 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461514 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461517 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461522 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461524 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461527 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461529 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461533 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461536 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:17:12.473038 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461539 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461542 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461545 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461548 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461555 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461558 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461561 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461569 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461572 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461574 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461577 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461579 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461582 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461584 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461587 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461591 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461593 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461596 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461598 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461601 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:17:12.473498 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461603 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461606 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461608 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461611 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461614 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461617 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461621 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461623 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.461626 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.461631 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.469584 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.469605 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.470410 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.470423 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470533 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:17:12.474002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470542 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470547 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470553 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470558 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470563 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470567 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470572 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470576 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470580 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470584 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470589 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470595 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470601 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470607 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470611 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470617 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470623 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470628 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470633 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:17:12.474376 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470638 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470642 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470647 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470651 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470656 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470661 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470665 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470670 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470675 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470688 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470693 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470697 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470702 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470706 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470710 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470714 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470719 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470724 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470730 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:17:12.474821 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470735 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470740 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470744 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470749 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470754 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470758 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470763 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470767 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470772 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470776 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470780 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470784 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470789 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470793 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470797 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470801 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470805 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470809 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470814 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470818 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:17:12.475341 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470822 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470826 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470832 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470843 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470847 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470852 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470862 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470866 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470870 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470875 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470879 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470883 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470887 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470891 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470895 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470899 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470903 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470907 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470912 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470916 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:17:12.475853 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470920 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470924 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470929 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470932 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470937 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470942 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470946 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470950 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470954 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470958 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470962 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470982 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470986 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470990 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470994 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.470998 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471009 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471014 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471017 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:17:12.476339 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471021 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.471029 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471925 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471953 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471959 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471980 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471986 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471991 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.471996 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472000 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472004 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472009 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472014 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472024 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472030 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:17:12.476784 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472034 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472038 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472045 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472053 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472058 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472063 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472068 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472073 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472077 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472081 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472086 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472096 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472100 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472105 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472110 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472146 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472152 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472156 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472161 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472166 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:17:12.477169 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472170 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472174 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472179 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472188 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472193 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472197 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472202 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472206 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472211 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472215 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472219 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472224 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472436 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472448 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472452 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472455 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472459 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472462 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472466 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472469 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:17:12.477645 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472471 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472474 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472477 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472480 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472483 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472485 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472488 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472491 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472498 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472501 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472504 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472507 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472509 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472512 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472514 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472519 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472524 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472527 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472531 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:17:12.478149 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472534 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472537 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472541 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472544 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472547 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472550 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472553 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472555 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472558 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472560 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472563 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472565 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472568 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472570 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472573 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472575 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472579 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472583 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472586 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:17:12.478591 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472589 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472592 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472594 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472597 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472600 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472602 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472605 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:12.472607 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.472612 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.472729 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.474895 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.476273 2579 server.go:1019] "Starting client certificate rotation" Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.476371 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.476407 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:17:12.479140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.478729 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:17:12.481350 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.481335 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:17:12.491050 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.491032 2579 log.go:25] "Validated CRI v1 runtime API" Jul 06 15:17:12.494231 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.494215 2579 log.go:25] "Validated CRI v1 image API" Jul 06 15:17:12.495010 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.494993 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 15:17:12.497346 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.497328 2579 fs.go:135] Filesystem UUIDs: map[1daff06d-f46e-4d52-82b1-9e9fdb8def21:/dev/nvme0n1p4 70d40a57-0555-40ce-b1ce-aedc134c6e3c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 15:17:12.497399 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.497345 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 15:17:12.503511 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.503378 2579 manager.go:216] Machine: {Timestamp:2026-07-06 15:17:12.501556574 +0000 UTC m=+0.307794236 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100883 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec217c5fe4e64d636f664bfeafb2e816 SystemUUID:ec217c5f-e4e6-4d63-6f66-4bfeafb2e816 BootID:8a59bdb9-92da-4e3c-acce-1fb46e9684dd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:b1:60:bd:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:b1:60:bd:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:91:9e:f2:c4:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 15:17:12.503511 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.503486 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 15:17:12.503610 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.503585 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 15:17:12.506565 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.506542 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 15:17:12.506726 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.506575 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 15:17:12.507372 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.507362 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 15:17:12.507404 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.507374 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 15:17:12.507404 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.507381 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:17:12.507761 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.507746 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:17:12.509240 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.509227 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:17:12.510890 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.510879 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 15:17:12.514261 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514249 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:17:12.514399 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514390 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 15:17:12.514433 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514426 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 06 15:17:12.514475 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514464 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 15:17:12.514508 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514490 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 15:17:12.514508 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514502 2579 kubelet.go:398] "Adding apiserver pod source" Jul 06 15:17:12.514558 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.514511 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 15:17:12.515135 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.515122 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:17:12.515191 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.515143 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:17:12.518914 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.518892 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 15:17:12.521387 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.521374 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 15:17:12.521429 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.521404 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 15:17:12.522640 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522629 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522645 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522652 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522657 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522666 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522671 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522679 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522684 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 15:17:12.522690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522690 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 15:17:12.522948 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522695 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 15:17:12.522948 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522704 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 15:17:12.522948 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.522709 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 15:17:12.523425 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.523415 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 15:17:12.523425 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.523424 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 15:17:12.526479 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.526465 2579 server.go:1268] "Started kubelet" Jul 06 15:17:12.526626 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.526589 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 15:17:12.526763 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.526566 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 15:17:12.526814 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.526783 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 15:17:12.527326 ip-10-0-129-138 systemd[1]: Started Kubernetes Kubelet. Jul 06 15:17:12.528089 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.527994 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 06 15:17:12.528219 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.528194 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 15:17:12.528219 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.528217 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 15:17:12.528326 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.528283 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 15:17:12.528996 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.528981 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 15:17:12.531335 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.531316 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 15:17:12.535002 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.534986 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppf7j" Jul 06 15:17:12.536340 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.536166 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 15:17:12.536340 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.536256 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:12.536340 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.536296 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 15:17:12.536798 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.536778 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 15:17:12.536798 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.536799 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 15:17:12.536930 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.536917 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 15:17:12.537041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537027 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 06 15:17:12.537041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537041 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 06 15:17:12.537311 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.536168 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-138.ec2.internal.18bfbc50c39085d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-138.ec2.internal,UID:ip-10-0-129-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-138.ec2.internal,},FirstTimestamp:2026-07-06 15:17:12.52643989 +0000 UTC m=+0.332677552,LastTimestamp:2026-07-06 15:17:12.52643989 +0000 UTC m=+0.332677552,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-138.ec2.internal,}" Jul 06 15:17:12.537674 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537661 2579 factory.go:153] Registering CRI-O factory Jul 06 15:17:12.537777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537766 2579 factory.go:223] Registration of the crio container factory successfully Jul 06 15:17:12.537897 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537849 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 15:17:12.537897 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537886 2579 factory.go:55] Registering systemd factory Jul 06 15:17:12.537897 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537895 2579 factory.go:223] Registration of the systemd container factory successfully Jul 06 15:17:12.538086 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537927 2579 factory.go:103] Registering Raw factory Jul 06 15:17:12.538086 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.537941 2579 manager.go:1196] Started watching for new ooms in manager Jul 06 15:17:12.538636 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.538619 2579 manager.go:349] Starting recovery of all containers Jul 06 15:17:12.540383 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.540356 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 15:17:12.540471 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.540381 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 15:17:12.541204 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.541181 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppf7j" Jul 06 15:17:12.551511 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.551495 2579 manager.go:354] Recovery completed Jul 06 15:17:12.555721 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.555708 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:12.557497 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.557484 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:12.557557 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.557509 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:12.557557 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.557523 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:12.558064 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.558050 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 15:17:12.558064 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.558062 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 15:17:12.558168 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.558076 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:17:12.558168 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.558084 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:12.559115 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.559101 2579 policy_none.go:49] "None policy: Start" Jul 06 15:17:12.559115 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.559116 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 15:17:12.559195 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.559127 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 15:17:12.559368 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.559354 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:12.559409 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.559379 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:12.559409 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.559389 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:12.560149 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.560139 2579 policy_none.go:47] "Start" Jul 06 15:17:12.600503 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600490 2579 manager.go:337] "Starting Device Plugin manager" Jul 06 15:17:12.600585 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.600518 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 15:17:12.600585 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600528 2579 server.go:87] "Starting device plugin registration server" Jul 06 15:17:12.600772 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600759 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 15:17:12.600829 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600774 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 15:17:12.600900 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600866 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 15:17:12.600949 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600940 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 15:17:12.600949 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.600949 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 15:17:12.601424 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.601406 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 15:17:12.601495 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.601461 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:12.662885 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.662755 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 15:17:12.664050 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.664034 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 15:17:12.664124 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.664076 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 15:17:12.664124 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.664104 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 15:17:12.664215 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:12.664141 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 15:17:12.666729 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.666703 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:17:12.700991 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.700960 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:12.702049 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.702030 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:12.702116 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.702070 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:12.702116 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.702083 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:12.702116 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:12.702112 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.206390 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.206376 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.206448 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.206396 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-138.ec2.internal\": node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.257894 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.257814 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.260903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.260885 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal"] Jul 06 15:17:14.260949 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.260944 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:14.261707 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.261692 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:14.261761 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.261720 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:14.261761 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.261730 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:14.262917 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.262903 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:14.263005 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.262992 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.263050 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263017 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:14.263586 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263569 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:14.263664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263591 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:14.263664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263610 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:14.263664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263613 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:14.263664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263624 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:14.263664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.263624 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:14.264926 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.264912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.264994 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.264937 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:17:14.265566 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.265550 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:17:14.265642 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.265589 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:17:14.265642 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.265605 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:17:14.299460 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.299444 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-138.ec2.internal\" not found" node="ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.303730 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.303714 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-138.ec2.internal\" not found" node="ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.358676 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.358659 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.433609 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.433590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6d8edb6dd5142fb60606870efd8df86-config\") pod \"kube-apiserver-proxy-ip-10-0-129-138.ec2.internal\" (UID: \"e6d8edb6dd5142fb60606870efd8df86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.433714 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.433620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52caca9a0658edd4a9efbac697c9a204-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal\" (UID: \"52caca9a0658edd4a9efbac697c9a204\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.433714 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.433657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52caca9a0658edd4a9efbac697c9a204-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal\" (UID: \"52caca9a0658edd4a9efbac697c9a204\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.459668 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.459644 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.534319 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.534253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6d8edb6dd5142fb60606870efd8df86-config\") pod \"kube-apiserver-proxy-ip-10-0-129-138.ec2.internal\" (UID: \"e6d8edb6dd5142fb60606870efd8df86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.534319 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.534291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52caca9a0658edd4a9efbac697c9a204-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal\" (UID: \"52caca9a0658edd4a9efbac697c9a204\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.534319 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.534309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52caca9a0658edd4a9efbac697c9a204-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal\" (UID: \"52caca9a0658edd4a9efbac697c9a204\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.534450 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.534344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52caca9a0658edd4a9efbac697c9a204-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal\" (UID: \"52caca9a0658edd4a9efbac697c9a204\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.534450 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.534346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6d8edb6dd5142fb60606870efd8df86-config\") pod \"kube-apiserver-proxy-ip-10-0-129-138.ec2.internal\" (UID: \"e6d8edb6dd5142fb60606870efd8df86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.534450 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.534367 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52caca9a0658edd4a9efbac697c9a204-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal\" (UID: \"52caca9a0658edd4a9efbac697c9a204\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.560384 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.560352 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.603543 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.603516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.608772 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.608756 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:14.661310 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.661286 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.761821 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.761803 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.862331 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.862271 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.962926 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:14.962905 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:14.972085 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.972067 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 15:17:14.972224 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:14.972206 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:17:15.039612 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.039578 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 15:12:14 +0000 UTC" deadline="2028-01-03 13:35:55.685807606 +0000 UTC" Jul 06 15:17:15.039612 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.039603 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13102h18m40.646207626s" Jul 06 15:17:15.040979 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.040959 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:17:15.063895 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:15.063877 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-138.ec2.internal\" not found" Jul 06 15:17:15.154394 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.154329 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:17:15.233266 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.233239 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" Jul 06 15:17:15.245020 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.245002 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:17:15.245908 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.245894 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" Jul 06 15:17:15.257141 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.257123 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:17:15.278864 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:15.278825 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d8edb6dd5142fb60606870efd8df86.slice/crio-e71f102bc0b67df8ff401a0a8a60b316cd58da61936433a4501d6ba15c7b6286 WatchSource:0}: Error finding container e71f102bc0b67df8ff401a0a8a60b316cd58da61936433a4501d6ba15c7b6286: Status 404 returned error can't find the container with id e71f102bc0b67df8ff401a0a8a60b316cd58da61936433a4501d6ba15c7b6286 Jul 06 15:17:15.279243 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:15.279220 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52caca9a0658edd4a9efbac697c9a204.slice/crio-75e928bdd32787810d518fe964f4af268d5b546ef9d4c8036e7587eca3456328 WatchSource:0}: Error finding container 75e928bdd32787810d518fe964f4af268d5b546ef9d4c8036e7587eca3456328: Status 404 returned error can't find the container with id 75e928bdd32787810d518fe964f4af268d5b546ef9d4c8036e7587eca3456328 Jul 06 15:17:15.283913 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.283898 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:17:15.424181 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:15.424096 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:17:16.012000 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.011965 2579 apiserver.go:52] "Watching apiserver" Jul 06 15:17:16.020884 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.020852 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 15:17:16.021334 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.021302 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kb8dz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2","openshift-cluster-node-tuning-operator/tuned-r65gg","openshift-dns/node-resolver-m4289","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal","openshift-network-operator/iptables-alerter-ptxs8","openshift-ovn-kubernetes/ovnkube-node-nz8dq","kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal","openshift-image-registry/node-ca-9qxhg","openshift-multus/multus-additional-cni-plugins-7wwlt","openshift-multus/multus-pzb57","openshift-multus/network-metrics-daemon-xlgj5","openshift-network-diagnostics/network-check-target-n2rxh","kube-system/global-pull-secret-syncer-tsxrq"] Jul 06 15:17:16.023345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.023115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.024393 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.024370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.025896 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.025869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.026610 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.026588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 15:17:16.026699 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.026599 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 15:17:16.027078 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.027064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.027417 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.027392 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.027497 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.027423 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fs6r9\"" Jul 06 15:17:16.027872 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.027854 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 15:17:16.027957 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.027874 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 15:17:16.028099 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.028081 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 15:17:16.028334 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.028319 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.028603 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.028562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.028725 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.028630 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:16.028725 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.028685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x6ccw\"" Jul 06 15:17:16.028851 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.028738 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 15:17:16.028851 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.028688 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.029460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.029147 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.029460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.029157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.029460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.029186 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kc4hf\"" Jul 06 15:17:16.029460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.029289 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.030472 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.029855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.031682 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.031087 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.031682 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.031126 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x62fk\"" Jul 06 15:17:16.031682 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.031405 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.031682 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.031424 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.032684 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.032481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.033363 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.033312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:16.033455 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.033380 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:16.033513 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.033503 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 15:17:16.034172 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.034154 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.034351 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.034332 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4jl77\"" Jul 06 15:17:16.034495 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.034409 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.034575 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.034540 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.034638 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.034600 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 15:17:16.037437 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.037391 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 15:17:16.037671 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.037654 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hswq6\"" Jul 06 15:17:16.037933 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.037825 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.038387 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.038366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.039562 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.039540 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 15:17:16.039813 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.039797 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9vhkj\"" Jul 06 15:17:16.039906 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.039882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.040456 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.040435 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 15:17:16.040537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.040490 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 15:17:16.040859 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.040828 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ts4hg\"" Jul 06 15:17:16.041045 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041030 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 15:17:16.041151 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041135 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 15:17:16.041587 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-run\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.041714 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-sys\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.041779 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-tmp\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.041779 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.041919 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041866 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d1d14f2-41fc-497f-accb-37200a7b7d79-serviceca\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.041919 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042020 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.041933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-ovn\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042069 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-hostroot\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.042069 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1da404a-495a-4f3e-b48e-e76d95554730-multus-daemon-config\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.042161 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjld\" (UniqueName: \"kubernetes.io/projected/c1da404a-495a-4f3e-b48e-e76d95554730-kube-api-access-jrjld\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.042161 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-systemd-units\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042161 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-env-overrides\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042161 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-etc-kubernetes\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.042353 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.042353 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-sys-fs\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.042353 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6t5v\" (UniqueName: \"kubernetes.io/projected/f0a1f690-c1ef-424c-88bb-d9996e4ac694-kube-api-access-t6t5v\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.042353 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.042281 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:16.042353 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-kubelet\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042353 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-systemd\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042687 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-etc-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.042777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysctl-d\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.042777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-host\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.042777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-tuned\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nkb\" (UniqueName: \"kubernetes.io/projected/9ba22a53-a802-4cc0-afac-6284f46f43a4-kube-api-access-v6nkb\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042886 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gngds\" (UniqueName: \"kubernetes.io/projected/eb81c620-57b3-465c-9241-75f051c777a8-kube-api-access-gngds\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-cni-bin\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-conf-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.042985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-lib-modules\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d1d14f2-41fc-497f-accb-37200a7b7d79-host\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-system-cni-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-k8s-cni-cncf-io\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-multus-certs\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-cnibin\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-log-socket\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-modprobe-d\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-systemd\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-cni-bin\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-cni-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043328 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-socket-dir-parent\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-kubernetes\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-run-netns\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-var-lib-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-ovnkube-config\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a1f690-c1ef-424c-88bb-d9996e4ac694-tmp-dir\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-registration-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-node-log\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysconfig\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0a1f690-c1ef-424c-88bb-d9996e4ac694-hosts-file\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a923adff-a506-4fdb-9e25-5623eed244fe-iptables-alerter-script\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-slash\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1da404a-495a-4f3e-b48e-e76d95554730-cni-binary-copy\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-kubelet\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043863 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66229ceb-f969-42be-a399-f698f9b35d29-dbus\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.043971 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-cni-netd\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb81c620-57b3-465c-9241-75f051c777a8-ovn-node-metrics-cert\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysctl-conf\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg2ws\" (UniqueName: \"kubernetes.io/projected/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-kube-api-access-fg2ws\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-socket-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.043997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-ovnkube-script-lib\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-os-release\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-netns\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-var-lib-kubelet\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66229ceb-f969-42be-a399-f698f9b35d29-kubelet-config\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fdh\" (UniqueName: \"kubernetes.io/projected/7d1d14f2-41fc-497f-accb-37200a7b7d79-kube-api-access-88fdh\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-device-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a923adff-a506-4fdb-9e25-5623eed244fe-host-slash\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-cni-multus\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z65jt\" (UniqueName: \"kubernetes.io/projected/a923adff-a506-4fdb-9e25-5623eed244fe-kube-api-access-z65jt\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.044689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044682 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rd9dd\"" Jul 06 15:17:16.045530 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 15:17:16.045530 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.044726 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 15:17:16.050644 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.050625 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:17:16.076874 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.076855 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkn76" Jul 06 15:17:16.086070 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.086051 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkn76" Jul 06 15:17:16.133936 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.133918 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 15:17:16.145235 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-etc-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.145346 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.145346 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysctl-d\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.145346 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-host\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.145346 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145336 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-tuned\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nkb\" (UniqueName: \"kubernetes.io/projected/9ba22a53-a802-4cc0-afac-6284f46f43a4-kube-api-access-v6nkb\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gngds\" (UniqueName: \"kubernetes.io/projected/eb81c620-57b3-465c-9241-75f051c777a8-kube-api-access-gngds\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145480 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysctl-d\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-cni-bin\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-cni-bin\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-etc-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.145537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-conf-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-lib-modules\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145567 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d1d14f2-41fc-497f-accb-37200a7b7d79-host\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-system-cni-dir\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145655 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-system-cni-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-k8s-cni-cncf-io\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-multus-certs\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktdx\" (UniqueName: \"kubernetes.io/projected/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-kube-api-access-dktdx\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-cnibin\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-log-socket\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145876 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-modprobe-d\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-systemd\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.146105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.145979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-cni-bin\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c768c2a9-fb9b-45ce-b420-e212167f77ad-agent-certs\") pod \"konnectivity-agent-kb8dz\" (UID: \"c768c2a9-fb9b-45ce-b420-e212167f77ad\") " pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-cni-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-socket-dir-parent\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-kubernetes\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-run-netns\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146120 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-multus-certs\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-var-lib-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-conf-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-ovnkube-config\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-system-cni-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a1f690-c1ef-424c-88bb-d9996e4ac694-tmp-dir\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-k8s-cni-cncf-io\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-host\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-registration-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:16.146901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-node-log\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c768c2a9-fb9b-45ce-b420-e212167f77ad-konnectivity-ca\") pod \"konnectivity-agent-kb8dz\" (UID: \"c768c2a9-fb9b-45ce-b420-e212167f77ad\") " pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146412 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-lib-modules\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysconfig\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0a1f690-c1ef-424c-88bb-d9996e4ac694-hosts-file\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146457 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-registration-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a923adff-a506-4fdb-9e25-5623eed244fe-iptables-alerter-script\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-slash\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-cni-bin\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1da404a-495a-4f3e-b48e-e76d95554730-cni-binary-copy\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-kubelet\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-cnibin\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66229ceb-f969-42be-a399-f698f9b35d29-dbus\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-log-socket\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-cni-netd\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb81c620-57b3-465c-9241-75f051c777a8-ovn-node-metrics-cert\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.147689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28pw\" (UniqueName: \"kubernetes.io/projected/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-kube-api-access-b28pw\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysctl-conf\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-ovnkube-config\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg2ws\" (UniqueName: \"kubernetes.io/projected/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-kube-api-access-fg2ws\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-socket-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-ovnkube-script-lib\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d1d14f2-41fc-497f-accb-37200a7b7d79-host\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-node-log\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-socket-dir-parent\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-multus-cni-dir\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-modprobe-d\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-kubernetes\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysconfig\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147005 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-var-lib-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0a1f690-c1ef-424c-88bb-d9996e4ac694-hosts-file\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147047 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-sysctl-conf\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-cni-netd\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147048 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-run-netns\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.148550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a1f690-c1ef-424c-88bb-d9996e4ac694-tmp-dir\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147142 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-kubelet\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-slash\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147327 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-socket-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a923adff-a506-4fdb-9e25-5623eed244fe-iptables-alerter-script\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147603 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66229ceb-f969-42be-a399-f698f9b35d29-dbus\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.146848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cnibin\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-os-release\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-netns\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-var-lib-kubelet\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1da404a-495a-4f3e-b48e-e76d95554730-cni-binary-copy\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66229ceb-f969-42be-a399-f698f9b35d29-kubelet-config\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66229ceb-f969-42be-a399-f698f9b35d29-kubelet-config\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fdh\" (UniqueName: \"kubernetes.io/projected/7d1d14f2-41fc-497f-accb-37200a7b7d79-kube-api-access-88fdh\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-device-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147813 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-os-release\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a923adff-a506-4fdb-9e25-5623eed244fe-host-slash\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147825 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-systemd\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.149397 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-ovnkube-script-lib\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147870 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-run-netns\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-cni-multus\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-device-dir\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-var-lib-kubelet\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-host-var-lib-cni-multus\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a923adff-a506-4fdb-9e25-5623eed244fe-host-slash\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.147985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65jt\" (UniqueName: \"kubernetes.io/projected/a923adff-a506-4fdb-9e25-5623eed244fe-kube-api-access-z65jt\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-run\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-sys\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148106 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-run\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-tmp\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148110 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-sys\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d1d14f2-41fc-497f-accb-37200a7b7d79-serviceca\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.150294 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.148256 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.148325 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:16.648305532 +0000 UTC m=+2.958677634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-ovn\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-hostroot\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1da404a-495a-4f3e-b48e-e76d95554730-multus-daemon-config\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjld\" (UniqueName: \"kubernetes.io/projected/c1da404a-495a-4f3e-b48e-e76d95554730-kube-api-access-jrjld\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-systemd-units\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-ovn\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-env-overrides\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-openvswitch\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-os-release\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-etc-kubernetes\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d1d14f2-41fc-497f-accb-37200a7b7d79-serviceca\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-sys-fs\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6t5v\" (UniqueName: \"kubernetes.io/projected/f0a1f690-c1ef-424c-88bb-d9996e4ac694-kube-api-access-t6t5v\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-kubelet\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-systemd\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-hostroot\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148764 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-run-systemd\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148813 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-host-kubelet\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.148869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb81c620-57b3-465c-9241-75f051c777a8-systemd-units\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.149001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1da404a-495a-4f3e-b48e-e76d95554730-etc-kubernetes\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.149020 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb81c620-57b3-465c-9241-75f051c777a8-env-overrides\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.149058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ba22a53-a802-4cc0-afac-6284f46f43a4-sys-fs\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.149274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1da404a-495a-4f3e-b48e-e76d95554730-multus-daemon-config\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.149709 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-etc-tuned\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.150479 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-tmp\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.151771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.151406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb81c620-57b3-465c-9241-75f051c777a8-ovn-node-metrics-cert\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.154048 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.153627 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:16.154048 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.153654 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:16.154048 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.153701 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:16.154048 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.153800 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:16.653772534 +0000 UTC m=+2.964144639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:16.156192 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.156028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nkb\" (UniqueName: \"kubernetes.io/projected/9ba22a53-a802-4cc0-afac-6284f46f43a4-kube-api-access-v6nkb\") pod \"aws-ebs-csi-driver-node-jjdg2\" (UID: \"9ba22a53-a802-4cc0-afac-6284f46f43a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.156827 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.156601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg2ws\" (UniqueName: \"kubernetes.io/projected/3cccfe7f-6e66-4e6e-8cf6-a75342eea470-kube-api-access-fg2ws\") pod \"tuned-r65gg\" (UID: \"3cccfe7f-6e66-4e6e-8cf6-a75342eea470\") " pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.157410 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.157393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gngds\" (UniqueName: \"kubernetes.io/projected/eb81c620-57b3-465c-9241-75f051c777a8-kube-api-access-gngds\") pod \"ovnkube-node-nz8dq\" (UID: \"eb81c620-57b3-465c-9241-75f051c777a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.161098 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.161057 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjld\" (UniqueName: \"kubernetes.io/projected/c1da404a-495a-4f3e-b48e-e76d95554730-kube-api-access-jrjld\") pod \"multus-pzb57\" (UID: \"c1da404a-495a-4f3e-b48e-e76d95554730\") " pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.161454 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.161434 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fdh\" (UniqueName: \"kubernetes.io/projected/7d1d14f2-41fc-497f-accb-37200a7b7d79-kube-api-access-88fdh\") pod \"node-ca-9qxhg\" (UID: \"7d1d14f2-41fc-497f-accb-37200a7b7d79\") " pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.162025 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.161976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z65jt\" (UniqueName: \"kubernetes.io/projected/a923adff-a506-4fdb-9e25-5623eed244fe-kube-api-access-z65jt\") pod \"iptables-alerter-ptxs8\" (UID: \"a923adff-a506-4fdb-9e25-5623eed244fe\") " pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.163894 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.163784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6t5v\" (UniqueName: \"kubernetes.io/projected/f0a1f690-c1ef-424c-88bb-d9996e4ac694-kube-api-access-t6t5v\") pod \"node-resolver-m4289\" (UID: \"f0a1f690-c1ef-424c-88bb-d9996e4ac694\") " pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.172157 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.171969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" event={"ID":"e6d8edb6dd5142fb60606870efd8df86","Type":"ContainerStarted","Data":"e71f102bc0b67df8ff401a0a8a60b316cd58da61936433a4501d6ba15c7b6286"} Jul 06 15:17:16.173732 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.173549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" event={"ID":"52caca9a0658edd4a9efbac697c9a204","Type":"ContainerStarted","Data":"75e928bdd32787810d518fe964f4af268d5b546ef9d4c8036e7587eca3456328"} Jul 06 15:17:16.249101 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-system-cni-dir\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249101 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktdx\" (UniqueName: \"kubernetes.io/projected/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-kube-api-access-dktdx\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c768c2a9-fb9b-45ce-b420-e212167f77ad-agent-certs\") pod \"konnectivity-agent-kb8dz\" (UID: \"c768c2a9-fb9b-45ce-b420-e212167f77ad\") " pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-system-cni-dir\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c768c2a9-fb9b-45ce-b420-e212167f77ad-konnectivity-ca\") pod \"konnectivity-agent-kb8dz\" (UID: \"c768c2a9-fb9b-45ce-b420-e212167f77ad\") " pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.249255 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28pw\" (UniqueName: \"kubernetes.io/projected/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-kube-api-access-b28pw\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cnibin\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249320 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.249312 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:17:16.74929439 +0000 UTC m=+3.059666496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:16.249905 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-os-release\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249905 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cnibin\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249905 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249905 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249476 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-os-release\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.249905 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.250068 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.249953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.250068 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.250009 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.250128 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.250097 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c768c2a9-fb9b-45ce-b420-e212167f77ad-konnectivity-ca\") pod \"konnectivity-agent-kb8dz\" (UID: \"c768c2a9-fb9b-45ce-b420-e212167f77ad\") " pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.251482 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.251461 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c768c2a9-fb9b-45ce-b420-e212167f77ad-agent-certs\") pod \"konnectivity-agent-kb8dz\" (UID: \"c768c2a9-fb9b-45ce-b420-e212167f77ad\") " pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.260816 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.260794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28pw\" (UniqueName: \"kubernetes.io/projected/a1848fe8-a558-43e2-83d1-6b7b2e0347f6-kube-api-access-b28pw\") pod \"multus-additional-cni-plugins-7wwlt\" (UID: \"a1848fe8-a558-43e2-83d1-6b7b2e0347f6\") " pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.261123 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.261098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktdx\" (UniqueName: \"kubernetes.io/projected/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-kube-api-access-dktdx\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.339047 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.338973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:16.341784 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.341657 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:17:16.350261 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.350242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pzb57" Jul 06 15:17:16.358889 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.358865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r65gg" Jul 06 15:17:16.366590 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.366571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4289" Jul 06 15:17:16.374133 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.374112 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptxs8" Jul 06 15:17:16.380815 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.380762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qxhg" Jul 06 15:17:16.388478 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.388457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" Jul 06 15:17:16.394108 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.394092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" Jul 06 15:17:16.400715 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.400697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:16.652551 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.652476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:16.652688 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.652655 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:16.652746 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.652736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:17.65271528 +0000 UTC m=+3.963087370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:16.753493 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.753464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:16.753647 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:16.753501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:16.753647 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.753613 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:16.753647 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.753623 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:16.753647 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.753637 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:16.753647 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.753645 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:16.753798 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.753671 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:17:17.753658001 +0000 UTC m=+4.064030090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:16.753798 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:16.753687 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:17.753678937 +0000 UTC m=+4.064051024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:17.087714 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:17.087672 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:12:16 +0000 UTC" deadline="2028-02-24 16:31:28.28217903 +0000 UTC" Jul 06 15:17:17.087714 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:17.087709 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14353h14m11.194473301s" Jul 06 15:17:17.160436 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:17.160408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:17.160584 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.160522 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:17.246427 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:17.246402 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda923adff_a506_4fdb_9e25_5623eed244fe.slice/crio-3d62b197a8facd58163ec9cc5c271b18097a92381ce6a5051850603bf1208aea WatchSource:0}: Error finding container 3d62b197a8facd58163ec9cc5c271b18097a92381ce6a5051850603bf1208aea: Status 404 returned error can't find the container with id 3d62b197a8facd58163ec9cc5c271b18097a92381ce6a5051850603bf1208aea Jul 06 15:17:17.247495 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:17.247471 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb81c620_57b3_465c_9241_75f051c777a8.slice/crio-ae41417f29cdc31ad97ba665998a970a258385f50ed210442504b63c2aa1f0c5 WatchSource:0}: Error finding container ae41417f29cdc31ad97ba665998a970a258385f50ed210442504b63c2aa1f0c5: Status 404 returned error can't find the container with id ae41417f29cdc31ad97ba665998a970a258385f50ed210442504b63c2aa1f0c5 Jul 06 15:17:17.248157 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:17.248134 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1d14f2_41fc_497f_accb_37200a7b7d79.slice/crio-d58e466039dc64417cc1c9f012b66a146b4cefde649d016332c44b79f5ffc07d WatchSource:0}: Error finding container d58e466039dc64417cc1c9f012b66a146b4cefde649d016332c44b79f5ffc07d: Status 404 returned error can't find the container with id d58e466039dc64417cc1c9f012b66a146b4cefde649d016332c44b79f5ffc07d Jul 06 15:17:17.249061 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:17.248869 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1da404a_495a_4f3e_b48e_e76d95554730.slice/crio-9933b81dd5b0c5831557c9aad5cf58bf44a3a792e66a38e8ba3ef7d41c6d48db WatchSource:0}: Error finding container 9933b81dd5b0c5831557c9aad5cf58bf44a3a792e66a38e8ba3ef7d41c6d48db: Status 404 returned error can't find the container with id 9933b81dd5b0c5831557c9aad5cf58bf44a3a792e66a38e8ba3ef7d41c6d48db Jul 06 15:17:17.250306 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:17.250271 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1848fe8_a558_43e2_83d1_6b7b2e0347f6.slice/crio-2d430af085b0650c8a7f9671bb4980ec7e31d1764d998d60a64269d7a8512ce9 WatchSource:0}: Error finding container 2d430af085b0650c8a7f9671bb4980ec7e31d1764d998d60a64269d7a8512ce9: Status 404 returned error can't find the container with id 2d430af085b0650c8a7f9671bb4980ec7e31d1764d998d60a64269d7a8512ce9 Jul 06 15:17:17.657988 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:17.657782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:17.658110 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.657947 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:17.658110 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.658049 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:19.658034837 +0000 UTC m=+5.968406925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:17.759021 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:17.758755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:17.759021 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:17.758861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:17.759021 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.758928 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:17.759021 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.758947 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:17.759021 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.758958 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:17.759021 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.759008 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:19.758992152 +0000 UTC m=+6.069364248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:17.759502 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.759474 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:17.759612 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:17.759545 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:17:19.759527038 +0000 UTC m=+6.069899144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:18.088445 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.088305 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:12:16 +0000 UTC" deadline="2028-01-05 09:39:02.914326035 +0000 UTC" Jul 06 15:17:18.088445 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.088366 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13146h21m44.825964187s" Jul 06 15:17:18.162493 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.162464 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:18.162666 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:18.162640 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:18.162948 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.162927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:18.163056 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:18.163035 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:18.203119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.202303 2579 generic.go:356] "Generic (PLEG): container finished" podID="52caca9a0658edd4a9efbac697c9a204" containerID="8daf796149b023de3a27446a275822e105fd19d6f92336749b82fdfe04b5dde3" exitCode=0 Jul 06 15:17:18.203119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.202390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" event={"ID":"52caca9a0658edd4a9efbac697c9a204","Type":"ContainerDied","Data":"8daf796149b023de3a27446a275822e105fd19d6f92336749b82fdfe04b5dde3"} Jul 06 15:17:18.206609 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.206582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" event={"ID":"9ba22a53-a802-4cc0-afac-6284f46f43a4","Type":"ContainerStarted","Data":"c0ab19c328130b854060fb8e5017837d44c1ee9d7cbb40941d14709b86cf163e"} Jul 06 15:17:18.223965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.223942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4289" event={"ID":"f0a1f690-c1ef-424c-88bb-d9996e4ac694","Type":"ContainerStarted","Data":"95a513b1091035a82fb64f3fa083234e0a42cc3eda46f61132184aaac7ca5afa"} Jul 06 15:17:18.236207 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.236180 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerStarted","Data":"2d430af085b0650c8a7f9671bb4980ec7e31d1764d998d60a64269d7a8512ce9"} Jul 06 15:17:18.245111 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.245051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pzb57" event={"ID":"c1da404a-495a-4f3e-b48e-e76d95554730","Type":"ContainerStarted","Data":"9933b81dd5b0c5831557c9aad5cf58bf44a3a792e66a38e8ba3ef7d41c6d48db"} Jul 06 15:17:18.256478 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.256451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qxhg" event={"ID":"7d1d14f2-41fc-497f-accb-37200a7b7d79","Type":"ContainerStarted","Data":"d58e466039dc64417cc1c9f012b66a146b4cefde649d016332c44b79f5ffc07d"} Jul 06 15:17:18.276701 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.276627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb8dz" event={"ID":"c768c2a9-fb9b-45ce-b420-e212167f77ad","Type":"ContainerStarted","Data":"c33721615e34409ac4630dbe908521fd3c0c11a215aec16fd2f7922d2a8fc626"} Jul 06 15:17:18.282706 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.282629 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r65gg" event={"ID":"3cccfe7f-6e66-4e6e-8cf6-a75342eea470","Type":"ContainerStarted","Data":"315865ba4528a93be8f66f52109e50371553e530f1a51480f3937666e907c365"} Jul 06 15:17:18.293557 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.293533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"ae41417f29cdc31ad97ba665998a970a258385f50ed210442504b63c2aa1f0c5"} Jul 06 15:17:18.309598 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.309510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptxs8" event={"ID":"a923adff-a506-4fdb-9e25-5623eed244fe","Type":"ContainerStarted","Data":"3d62b197a8facd58163ec9cc5c271b18097a92381ce6a5051850603bf1208aea"} Jul 06 15:17:18.317385 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.316875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" event={"ID":"e6d8edb6dd5142fb60606870efd8df86","Type":"ContainerStarted","Data":"399376feaaa5299501b52b49b811ae479ba85c2b32cb10d2bdb36b2a3fa0a69b"} Jul 06 15:17:18.332576 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:18.332392 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-138.ec2.internal" podStartSLOduration=3.332307109 podStartE2EDuration="3.332307109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:18.332029265 +0000 UTC m=+4.642401376" watchObservedRunningTime="2026-07-06 15:17:18.332307109 +0000 UTC m=+4.642679220" Jul 06 15:17:19.161545 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:19.161068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:19.161545 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.161192 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:19.326894 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:19.326790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" event={"ID":"52caca9a0658edd4a9efbac697c9a204","Type":"ContainerStarted","Data":"3532890d0b4f0f100f6c279abaf57e24899bc799e13afe9df00d83792d5f5072"} Jul 06 15:17:19.673909 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:19.673872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:19.674081 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.674018 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:19.674081 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.674078 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:23.674061258 +0000 UTC m=+9.984433350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:19.775138 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:19.774851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:19.775138 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:19.774913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:19.775138 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.775058 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:19.775138 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.775071 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:19.775138 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.775147 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:17:23.775128287 +0000 UTC m=+10.085500401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:19.775537 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.775079 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:19.775537 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.775473 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:19.775537 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:19.775518 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:23.775504782 +0000 UTC m=+10.085876873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:20.161563 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:20.160957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:20.161563 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:20.161080 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:20.161563 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:20.161421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:20.161563 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:20.161518 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:21.160446 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:21.160397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:21.160628 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:21.160591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:22.161268 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:22.161229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:22.161864 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:22.161346 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:22.161864 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:22.161229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:22.161864 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:22.161716 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:23.160241 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:23.160150 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:23.160452 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.160284 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:23.707361 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:23.707274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:23.707823 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.707466 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:23.707823 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.707535 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:31.707516253 +0000 UTC m=+18.017888355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:23.808573 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:23.808509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:23.808746 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:23.808591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:23.808746 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.808664 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:23.808746 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.808691 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:23.808746 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.808703 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:23.808746 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.808708 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:23.809021 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.808766 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:31.80874739 +0000 UTC m=+18.119119503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:23.809021 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:23.808788 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:17:31.808776924 +0000 UTC m=+18.119149016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:24.161020 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:24.160991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:24.161188 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:24.161092 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:24.161188 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:24.161176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:24.161315 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:24.161293 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:25.161635 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:25.161093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:25.161635 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:25.161219 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:26.163478 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:26.163448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:26.163925 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:26.163550 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:26.163925 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:26.163613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:26.163925 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:26.163732 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:27.160851 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:27.160782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:27.161026 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:27.160929 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:28.160646 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.160477 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:28.161039 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.160537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:28.161039 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:28.160748 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:28.161039 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:28.160847 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:28.349240 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.349198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" event={"ID":"9ba22a53-a802-4cc0-afac-6284f46f43a4","Type":"ContainerStarted","Data":"253f25013109778cba20f3653836dd8d1614300963ceef95f0691c514a4f0761"} Jul 06 15:17:28.350818 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.350785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4289" event={"ID":"f0a1f690-c1ef-424c-88bb-d9996e4ac694","Type":"ContainerStarted","Data":"df9fb419bd78315ae3dbd5912a78ff03402aa20cda094218daea23551e580b51"} Jul 06 15:17:28.352495 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.352469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerStarted","Data":"cd186e1d71d8fc4ab9aed98d5ed617ddbbb1a8b341952a29d672f06e515fb530"} Jul 06 15:17:28.353910 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.353888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qxhg" event={"ID":"7d1d14f2-41fc-497f-accb-37200a7b7d79","Type":"ContainerStarted","Data":"58ca07111a69890a54b71fa97067676999e83c4b96ffb977f8f63267c77093bd"} Jul 06 15:17:28.355474 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.355443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb8dz" event={"ID":"c768c2a9-fb9b-45ce-b420-e212167f77ad","Type":"ContainerStarted","Data":"40b2cd1cac9d592e01f6bebc2a22d703831deb542065a00c2ee31a4b256de262"} Jul 06 15:17:28.357056 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.357030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r65gg" event={"ID":"3cccfe7f-6e66-4e6e-8cf6-a75342eea470","Type":"ContainerStarted","Data":"52210e29e22859efebc636731f7ba3e4d6a018ffe5e4816d4dd450668bf39ab6"} Jul 06 15:17:28.369442 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.369389 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m4289" podStartSLOduration=4.144861166 podStartE2EDuration="14.369378315s" totalImagesPullingTime="10.224517149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:28.369311291 +0000 UTC m=+14.679683401" watchObservedRunningTime="2026-07-06 15:17:28.369378315 +0000 UTC m=+14.679750424" Jul 06 15:17:28.369551 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.369493 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-138.ec2.internal" podStartSLOduration=13.369486395 podStartE2EDuration="13.369486395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:19.3417926 +0000 UTC m=+5.652164711" watchObservedRunningTime="2026-07-06 15:17:28.369486395 +0000 UTC m=+14.679858507" Jul 06 15:17:28.397060 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.397020 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r65gg" podStartSLOduration=3.9785653610000002 podStartE2EDuration="14.397006645s" totalImagesPullingTime="10.418441284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:28.396803557 +0000 UTC m=+14.707175667" watchObservedRunningTime="2026-07-06 15:17:28.397006645 +0000 UTC m=+14.707378755" Jul 06 15:17:28.414917 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.414873 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kb8dz" podStartSLOduration=4.217878695 podStartE2EDuration="14.414858875s" totalImagesPullingTime="10.19698018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:28.414588502 +0000 UTC m=+14.724960614" watchObservedRunningTime="2026-07-06 15:17:28.414858875 +0000 UTC m=+14.725230986" Jul 06 15:17:28.433762 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:28.433719 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9qxhg" podStartSLOduration=4.209527158 podStartE2EDuration="14.433702103s" totalImagesPullingTime="10.224174945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:28.433178067 +0000 UTC m=+14.743550176" watchObservedRunningTime="2026-07-06 15:17:28.433702103 +0000 UTC m=+14.744074282" Jul 06 15:17:29.160407 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:29.160385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:29.160525 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:29.160489 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:29.361072 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:29.361039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptxs8" event={"ID":"a923adff-a506-4fdb-9e25-5623eed244fe","Type":"ContainerStarted","Data":"59236a294b9edf2be58ccb17afa41dd3e4e91d656a50abbfa4b71c0d102b403f"} Jul 06 15:17:30.160464 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:30.160432 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:30.160641 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:30.160445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:30.160641 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:30.160558 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:30.160641 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:30.160624 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:31.161201 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.161164 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:31.161860 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.161291 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:31.717850 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.717809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:31.718445 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.718428 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:31.736915 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.736873 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ptxs8" podStartSLOduration=7.510364286 podStartE2EDuration="17.736859602s" totalImagesPullingTime="10.226495316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:29.380879413 +0000 UTC m=+15.691251525" watchObservedRunningTime="2026-07-06 15:17:31.736859602 +0000 UTC m=+18.047231712" Jul 06 15:17:31.770756 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.770732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:31.770906 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.770888 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:31.770973 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.770951 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:47.770934574 +0000 UTC m=+34.081306663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:31.871621 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.871587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:31.871791 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:31.871634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:31.871791 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.871765 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:31.871912 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.871860 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:17:47.871824266 +0000 UTC m=+34.182196360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:31.871912 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.871773 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:31.871912 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.871885 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:31.871912 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.871899 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:31.872078 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:31.871945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:17:47.871930678 +0000 UTC m=+34.182302765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:32.161195 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:32.161165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:32.161358 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:32.161297 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:32.161932 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:32.161373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:32.161932 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:32.161487 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:32.368550 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:32.368515 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1848fe8-a558-43e2-83d1-6b7b2e0347f6" containerID="cd186e1d71d8fc4ab9aed98d5ed617ddbbb1a8b341952a29d672f06e515fb530" exitCode=0 Jul 06 15:17:32.368753 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:32.368586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerDied","Data":"cd186e1d71d8fc4ab9aed98d5ed617ddbbb1a8b341952a29d672f06e515fb530"} Jul 06 15:17:32.368886 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:32.368865 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:32.369403 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:32.369383 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kb8dz" Jul 06 15:17:33.160627 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:33.160578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:33.160817 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:33.160721 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:34.161733 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:34.161696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:34.162343 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:34.161793 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:34.162343 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:34.161857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:34.162343 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:34.161976 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:35.161101 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:35.161063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:35.161272 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:35.161207 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:36.160564 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:36.160531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:36.161045 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:36.160537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:36.161045 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:36.160640 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:36.161045 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:36.160704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:36.892939 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:36.892659 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 15:17:37.107759 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.107683 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T15:17:36.892938659Z","UUID":"0ef984ce-8cd6-42f9-b655-ccdd149513b9","Handler":null,"Name":"","Endpoint":""} Jul 06 15:17:37.108966 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.108950 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 15:17:37.109043 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.108984 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 15:17:37.160292 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.160275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:37.160390 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:37.160362 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:37.382654 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.382615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"5fdc77dde4840b17d61625b1f3a9ae91319a4af0b69503111bdcbc4333c4f271"} Jul 06 15:17:37.383087 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.382713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"1d21843d879e0311fba895f1b8ce5a61eb5c6cd3693a6538fc0f43875863fb6f"} Jul 06 15:17:37.383087 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.382768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"2577a397e85a0c3cde2c9b12728c0a83284e94f84e657b8e9b23b5cf2f5b80d9"} Jul 06 15:17:37.383087 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.382811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"3f6effb15be1f98fbcae08ddc2f309a3dccef008de8703727f9ef66c4ffa1d15"} Jul 06 15:17:37.383087 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.382870 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"470803f67ad3be75d9c0296bf99c99650204e389d1dffe2b9aa6902b625273de"} Jul 06 15:17:37.383087 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.382897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"651b0d14b1f2aa7af2ccff92896a9778cf875e9b20bc3d556ecedb69a11a5427"} Jul 06 15:17:37.384329 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.384306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" event={"ID":"9ba22a53-a802-4cc0-afac-6284f46f43a4","Type":"ContainerStarted","Data":"e3a9464aeb949653914c776a9a62535177a50452aba086a0079cd977b428b8db"} Jul 06 15:17:37.385575 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:37.385542 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pzb57" event={"ID":"c1da404a-495a-4f3e-b48e-e76d95554730","Type":"ContainerStarted","Data":"de182f998a450e1422d20ca89fa8871243c215707329e95870609407fff573f9"} Jul 06 15:17:38.160935 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:38.160909 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:38.161195 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:38.160913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:38.161195 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:38.161045 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:38.161195 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:38.161094 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:38.390221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:38.390181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" event={"ID":"9ba22a53-a802-4cc0-afac-6284f46f43a4","Type":"ContainerStarted","Data":"5e143880e6458698e96e4d2aacbe3d818dcc79a09bf67cd6cb4c549105c4963d"} Jul 06 15:17:38.413757 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:38.413666 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pzb57" podStartSLOduration=5.213346979 podStartE2EDuration="24.413648865s" totalImagesPullingTime="19.200301886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:37.419401132 +0000 UTC m=+23.729773243" watchObservedRunningTime="2026-07-06 15:17:38.413648865 +0000 UTC m=+24.724021039" Jul 06 15:17:38.414006 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:38.413981 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjdg2" podStartSLOduration=4.047986346 podStartE2EDuration="24.413971739s" totalImagesPullingTime="20.365985393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:38.413375308 +0000 UTC m=+24.723747449" watchObservedRunningTime="2026-07-06 15:17:38.413971739 +0000 UTC m=+24.724343851" Jul 06 15:17:39.160777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:39.160744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:39.160955 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:39.160853 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:39.396558 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:39.396512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"54ecfe170043d61ada408a43d01752c4a318fbed8c323c4e97f2b1b6026b101f"} Jul 06 15:17:40.160914 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:40.160881 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:40.161083 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:40.161008 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:40.161083 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:40.161063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:40.161181 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:40.161164 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:41.160756 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:41.160722 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:41.161252 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:41.160858 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:42.160635 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:42.160612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:42.160770 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:42.160748 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:42.160814 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:42.160795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:42.161142 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:42.160899 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:42.406337 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:42.406035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" event={"ID":"eb81c620-57b3-465c-9241-75f051c777a8","Type":"ContainerStarted","Data":"3cfcf6bff25c0dd1f627b0a1dc5fec3d405b0ecf2b75d51d68ca6ee155b5656c"} Jul 06 15:17:42.406462 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:42.406342 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:42.423013 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:42.422993 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:42.441221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:42.441181 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" podStartSLOduration=9.199005925 podStartE2EDuration="28.441168367s" totalImagesPullingTime="19.242162442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:42.439920958 +0000 UTC m=+28.750293068" watchObservedRunningTime="2026-07-06 15:17:42.441168367 +0000 UTC m=+28.751540476" Jul 06 15:17:43.160640 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:43.160613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:43.160793 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:43.160700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:43.411478 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:43.411400 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1848fe8-a558-43e2-83d1-6b7b2e0347f6" containerID="cdcda3201cb85c0a330111024510ffdd3e18a7be14fe7176e913931982bf45e1" exitCode=0 Jul 06 15:17:43.411953 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:43.411478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerDied","Data":"cdcda3201cb85c0a330111024510ffdd3e18a7be14fe7176e913931982bf45e1"} Jul 06 15:17:43.412086 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:43.412065 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:43.412228 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:43.412213 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:43.432199 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:43.432172 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:17:44.161441 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.161385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:44.161740 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:44.161481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:44.161740 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.161579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:44.161740 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:44.161709 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:44.171932 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.171904 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2rxh"] Jul 06 15:17:44.175590 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.175562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tsxrq"] Jul 06 15:17:44.175700 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.175647 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:44.175762 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:44.175735 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:44.176213 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.176192 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xlgj5"] Jul 06 15:17:44.413803 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.413775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:44.413803 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:44.413787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:44.414205 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:44.413889 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:44.414205 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:44.413933 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:45.418205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:45.418040 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1848fe8-a558-43e2-83d1-6b7b2e0347f6" containerID="8098b07360b06c928ac6d32257999e3ad9c9b6496cd44847b35c372d8011705d" exitCode=0 Jul 06 15:17:45.418568 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:45.418108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerDied","Data":"8098b07360b06c928ac6d32257999e3ad9c9b6496cd44847b35c372d8011705d"} Jul 06 15:17:46.160284 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:46.160255 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:46.160442 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:46.160264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:46.160442 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:46.160370 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:46.160442 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:46.160386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:46.160557 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:46.160461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:46.160600 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:46.160553 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:47.423686 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:47.423655 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1848fe8-a558-43e2-83d1-6b7b2e0347f6" containerID="15817959dc29d1fb85b60d928158c2d54df0dcce9bc7e50a658302d69b142ea0" exitCode=0 Jul 06 15:17:47.424293 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:47.423705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerDied","Data":"15817959dc29d1fb85b60d928158c2d54df0dcce9bc7e50a658302d69b142ea0"} Jul 06 15:17:47.791473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:47.791446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:47.791634 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.791567 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:47.791634 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.791613 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret podName:66229ceb-f969-42be-a399-f698f9b35d29 nodeName:}" failed. No retries permitted until 2026-07-06 15:18:19.791600363 +0000 UTC m=+66.101972451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret") pod "global-pull-secret-syncer-tsxrq" (UID: "66229ceb-f969-42be-a399-f698f9b35d29") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:17:47.892673 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:47.892641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:47.892859 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:47.892696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:47.892859 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.892812 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:47.892963 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.892886 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:18:19.892870282 +0000 UTC m=+66.203242379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:17:47.893016 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.893002 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:17:47.893067 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.893021 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:17:47.893067 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.893030 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fdpcn for pod openshift-network-diagnostics/network-check-target-n2rxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:47.893152 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:47.893076 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn podName:5d6844b8-6423-49b3-9414-04de43090fe6 nodeName:}" failed. No retries permitted until 2026-07-06 15:18:19.893061383 +0000 UTC m=+66.203433470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdpcn" (UniqueName: "kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn") pod "network-check-target-n2rxh" (UID: "5d6844b8-6423-49b3-9414-04de43090fe6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:17:48.160324 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:48.160227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:48.160480 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:48.160239 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:48.160480 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:48.160369 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:17:48.160480 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:48.160386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:48.160652 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:48.160517 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsxrq" podUID="66229ceb-f969-42be-a399-f698f9b35d29" Jul 06 15:17:48.160715 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:48.160645 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2rxh" podUID="5d6844b8-6423-49b3-9414-04de43090fe6" Jul 06 15:17:50.006846 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.006816 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-138.ec2.internal" event="NodeReady" Jul 06 15:17:50.007269 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.006954 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 15:17:50.044990 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.044954 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7487f889c8-qzm8j"] Jul 06 15:17:50.046772 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.046751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.049502 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.049480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7t2f5\"" Jul 06 15:17:50.049623 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.049564 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 15:17:50.050350 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.050327 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 15:17:50.050350 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.050349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 15:17:50.056298 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.056279 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 15:17:50.056745 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.056728 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j8wqz"] Jul 06 15:17:50.058222 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.058209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.061901 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.061884 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 15:17:50.062388 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.062366 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8l7xg\"" Jul 06 15:17:50.062583 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.062563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 15:17:50.064090 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.064070 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7487f889c8-qzm8j"] Jul 06 15:17:50.069821 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.069806 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x5js5"] Jul 06 15:17:50.071337 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.071322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.072643 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.072627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8wqz"] Jul 06 15:17:50.074146 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.074113 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 15:17:50.074330 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.074310 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x9pws\"" Jul 06 15:17:50.074403 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.074318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 15:17:50.074563 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.074551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 15:17:50.083988 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.083971 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x5js5"] Jul 06 15:17:50.161124 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.161057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:17:50.161258 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.161057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:17:50.161258 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.161209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:17:50.164197 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.164174 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:17:50.164326 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.164213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gh99x\"" Jul 06 15:17:50.164326 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.164230 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:17:50.164326 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.164250 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:17:50.164491 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.164452 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2rt6\"" Jul 06 15:17:50.164596 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.164576 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:17:50.208022 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.207999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzz2t\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-kube-api-access-hzz2t\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208129 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fab1e20-88ea-4555-87f2-d3aca283cee6-cert\") pod \"ingress-canary-x5js5\" (UID: \"7fab1e20-88ea-4555-87f2-d3aca283cee6\") " pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.208129 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208129 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-ca-trust-extracted\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208252 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.208252 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-certificates\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208252 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wdnr\" (UniqueName: \"kubernetes.io/projected/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-kube-api-access-9wdnr\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.208343 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-installation-pull-secrets\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208343 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-image-registry-private-configuration\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208404 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-trusted-ca\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208404 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-config-volume\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.208404 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-tmp-dir\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.208497 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-bound-sa-token\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.208497 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.208453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbv4v\" (UniqueName: \"kubernetes.io/projected/7fab1e20-88ea-4555-87f2-d3aca283cee6-kube-api-access-xbv4v\") pod \"ingress-canary-x5js5\" (UID: \"7fab1e20-88ea-4555-87f2-d3aca283cee6\") " pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.308886 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.308847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-certificates\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.308886 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.308887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wdnr\" (UniqueName: \"kubernetes.io/projected/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-kube-api-access-9wdnr\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.309107 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.308916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-installation-pull-secrets\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309107 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.308944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-image-registry-private-configuration\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309216 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-trusted-ca\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309216 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-config-volume\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.309216 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-tmp-dir\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.309331 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-bound-sa-token\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309331 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbv4v\" (UniqueName: \"kubernetes.io/projected/7fab1e20-88ea-4555-87f2-d3aca283cee6-kube-api-access-xbv4v\") pod \"ingress-canary-x5js5\" (UID: \"7fab1e20-88ea-4555-87f2-d3aca283cee6\") " pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.309331 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzz2t\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-kube-api-access-hzz2t\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309458 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fab1e20-88ea-4555-87f2-d3aca283cee6-cert\") pod \"ingress-canary-x5js5\" (UID: \"7fab1e20-88ea-4555-87f2-d3aca283cee6\") " pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.309458 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309458 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-ca-trust-extracted\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309458 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.309653 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-certificates\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.309653 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.309544 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:17:50.309653 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.309599 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:17:50.809582399 +0000 UTC m=+37.119954506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.309787 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-tmp-dir\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.310095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-ca-trust-extracted\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.310134 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-trusted-ca\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.310180 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.310194 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.310245 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:17:50.810229815 +0000 UTC m=+37.120601920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:17:50.310345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.310286 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-config-volume\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.313511 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.313486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-image-registry-private-configuration\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.313604 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.313580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-installation-pull-secrets\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.313679 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.313664 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fab1e20-88ea-4555-87f2-d3aca283cee6-cert\") pod \"ingress-canary-x5js5\" (UID: \"7fab1e20-88ea-4555-87f2-d3aca283cee6\") " pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.318690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.318671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-bound-sa-token\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.318883 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.318857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wdnr\" (UniqueName: \"kubernetes.io/projected/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-kube-api-access-9wdnr\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.319708 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.319682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzz2t\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-kube-api-access-hzz2t\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.319958 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.319919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbv4v\" (UniqueName: \"kubernetes.io/projected/7fab1e20-88ea-4555-87f2-d3aca283cee6-kube-api-access-xbv4v\") pod \"ingress-canary-x5js5\" (UID: \"7fab1e20-88ea-4555-87f2-d3aca283cee6\") " pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.380061 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.380036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x5js5" Jul 06 15:17:50.523017 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.522762 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x5js5"] Jul 06 15:17:50.527493 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:17:50.527465 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fab1e20_88ea_4555_87f2_d3aca283cee6.slice/crio-582ccda7f1bf6eb98c9fd66672cd98bb6a372be03b9286c2a4fef47ee0f42e0d WatchSource:0}: Error finding container 582ccda7f1bf6eb98c9fd66672cd98bb6a372be03b9286c2a4fef47ee0f42e0d: Status 404 returned error can't find the container with id 582ccda7f1bf6eb98c9fd66672cd98bb6a372be03b9286c2a4fef47ee0f42e0d Jul 06 15:17:50.812731 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.812697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:50.812903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:50.812748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:50.812959 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.812913 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:17:50.812996 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.812969 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:17:51.812955133 +0000 UTC m=+38.123327221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:17:50.813156 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.813131 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:17:50.813156 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.813152 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:17:50.813323 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:50.813202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:17:51.813183888 +0000 UTC m=+38.123555997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:17:51.435178 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:51.435144 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x5js5" event={"ID":"7fab1e20-88ea-4555-87f2-d3aca283cee6","Type":"ContainerStarted","Data":"582ccda7f1bf6eb98c9fd66672cd98bb6a372be03b9286c2a4fef47ee0f42e0d"} Jul 06 15:17:51.819554 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:51.819510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:51.819751 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:51.819640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:51.819751 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:51.819673 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:17:51.819751 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:51.819729 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:17:51.819751 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:51.819740 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:17:51.819751 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:51.819745 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:17:53.819724438 +0000 UTC m=+40.130096532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:17:51.819996 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:51.819771 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:17:53.819762543 +0000 UTC m=+40.130134631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:17:52.440751 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:52.440723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerStarted","Data":"2e75a624511aa3deb891c9741b6a6a75ecfaa3660db33749589ab7da33b69677"} Jul 06 15:17:53.446358 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:53.446324 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1848fe8-a558-43e2-83d1-6b7b2e0347f6" containerID="2e75a624511aa3deb891c9741b6a6a75ecfaa3660db33749589ab7da33b69677" exitCode=0 Jul 06 15:17:53.446781 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:53.446386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerDied","Data":"2e75a624511aa3deb891c9741b6a6a75ecfaa3660db33749589ab7da33b69677"} Jul 06 15:17:53.835254 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:53.835220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:53.835254 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:53.835261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:53.835436 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:53.835359 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:17:53.835436 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:53.835366 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:17:53.835436 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:53.835383 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:17:53.835436 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:53.835414 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:17:57.835398002 +0000 UTC m=+44.145770090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:17:53.835436 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:53.835427 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:17:57.835421904 +0000 UTC m=+44.145793992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:17:54.452720 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:54.452515 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1848fe8-a558-43e2-83d1-6b7b2e0347f6" containerID="794efc1aaf1766f1d56a30332585ed8bc0c97405bef972a74ff5155a044312ab" exitCode=0 Jul 06 15:17:54.453127 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:54.452595 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerDied","Data":"794efc1aaf1766f1d56a30332585ed8bc0c97405bef972a74ff5155a044312ab"} Jul 06 15:17:55.458077 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:55.458048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" event={"ID":"a1848fe8-a558-43e2-83d1-6b7b2e0347f6","Type":"ContainerStarted","Data":"c5424e1d6768c02d7574784e5cfef25e4c9650715bde2e16b6a7c8409a107326"} Jul 06 15:17:55.459572 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:55.459551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x5js5" event={"ID":"7fab1e20-88ea-4555-87f2-d3aca283cee6","Type":"ContainerStarted","Data":"cc95cd026ffb4b5a1d6f5031ac0fd0a293e5357f60c87f8740706755f0909157"} Jul 06 15:17:55.487285 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:55.487238 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7wwlt" podStartSLOduration=13.888771309 podStartE2EDuration="41.487223896s" totalImagesPullingTime="27.598452587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:55.48544077 +0000 UTC m=+41.795812880" watchObservedRunningTime="2026-07-06 15:17:55.487223896 +0000 UTC m=+41.797596006" Jul 06 15:17:56.482093 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:56.482049 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x5js5" podStartSLOduration=1.68723712 podStartE2EDuration="6.482034773s" totalImagesPullingTime="4.794797653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:17:56.481090874 +0000 UTC m=+42.791462986" watchObservedRunningTime="2026-07-06 15:17:56.482034773 +0000 UTC m=+42.792406876" Jul 06 15:17:57.865053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:57.865017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:17:57.865053 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:17:57.865057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:17:57.865476 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:57.865161 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:17:57.865476 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:57.865210 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:18:05.865195963 +0000 UTC m=+52.175568052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:17:57.865476 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:57.865159 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:17:57.865476 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:57.865256 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:17:57.865476 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:17:57.865299 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:18:05.865286273 +0000 UTC m=+52.175658361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:18:05.922749 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:05.922694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:18:05.922749 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:05.922754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:18:05.923454 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:05.922857 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:18:05.923454 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:05.922877 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:18:05.923454 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:05.922878 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:18:05.923454 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:05.922949 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:18:21.92293397 +0000 UTC m=+68.233306058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:18:05.923454 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:05.922965 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:18:21.922959721 +0000 UTC m=+68.233331809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:18:15.428532 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:15.428506 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nz8dq" Jul 06 15:18:19.820001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.819950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:18:19.823735 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.823718 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:18:19.834895 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.834877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66229ceb-f969-42be-a399-f698f9b35d29-original-pull-secret\") pod \"global-pull-secret-syncer-tsxrq\" (UID: \"66229ceb-f969-42be-a399-f698f9b35d29\") " pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:18:19.878074 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.878050 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsxrq" Jul 06 15:18:19.920399 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.920364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:18:19.920544 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.920444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:18:19.923672 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.923641 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:18:19.923791 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.923777 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:18:19.931537 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:19.931517 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:18:19.931633 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:19.931625 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:19:23.931606766 +0000 UTC m=+130.241978861 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : secret "metrics-daemon-secret" not found Jul 06 15:18:19.934097 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.934078 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:18:19.944937 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.944914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdpcn\" (UniqueName: \"kubernetes.io/projected/5d6844b8-6423-49b3-9414-04de43090fe6-kube-api-access-fdpcn\") pod \"network-check-target-n2rxh\" (UID: \"5d6844b8-6423-49b3-9414-04de43090fe6\") " pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:18:19.998350 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:19.998323 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tsxrq"] Jul 06 15:18:20.001324 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:18:20.001293 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66229ceb_f969_42be_a399_f698f9b35d29.slice/crio-1d2e3a2b745d26c3f0a34c5dd5d155cea1e61fba94c844ec2638ff292f8546ac WatchSource:0}: Error finding container 1d2e3a2b745d26c3f0a34c5dd5d155cea1e61fba94c844ec2638ff292f8546ac: Status 404 returned error can't find the container with id 1d2e3a2b745d26c3f0a34c5dd5d155cea1e61fba94c844ec2638ff292f8546ac Jul 06 15:18:20.176241 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:20.176172 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2rt6\"" Jul 06 15:18:20.182705 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:20.182684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:18:20.299923 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:20.299889 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2rxh"] Jul 06 15:18:20.302422 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:18:20.302385 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6844b8_6423_49b3_9414_04de43090fe6.slice/crio-2b3f46911575cc9e453ab509ac9795ef1d983e9f3bd3f63fe525a32bbe76601a WatchSource:0}: Error finding container 2b3f46911575cc9e453ab509ac9795ef1d983e9f3bd3f63fe525a32bbe76601a: Status 404 returned error can't find the container with id 2b3f46911575cc9e453ab509ac9795ef1d983e9f3bd3f63fe525a32bbe76601a Jul 06 15:18:20.517848 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:20.517803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2rxh" event={"ID":"5d6844b8-6423-49b3-9414-04de43090fe6","Type":"ContainerStarted","Data":"2b3f46911575cc9e453ab509ac9795ef1d983e9f3bd3f63fe525a32bbe76601a"} Jul 06 15:18:20.518703 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:20.518681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tsxrq" event={"ID":"66229ceb-f969-42be-a399-f698f9b35d29","Type":"ContainerStarted","Data":"1d2e3a2b745d26c3f0a34c5dd5d155cea1e61fba94c844ec2638ff292f8546ac"} Jul 06 15:18:21.934723 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:21.934685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:18:21.935173 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:21.934728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:18:21.935173 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:21.934869 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:18:21.935173 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:21.934883 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:18:21.935173 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:21.934909 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:18:21.935173 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:21.934931 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:18:53.934916683 +0000 UTC m=+100.245288771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:18:21.935173 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:21.934962 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:18:53.934945027 +0000 UTC m=+100.245317142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:18:25.532659 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:25.532620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2rxh" event={"ID":"5d6844b8-6423-49b3-9414-04de43090fe6","Type":"ContainerStarted","Data":"84875b3f0181a5f1c6b025f968078731f261dff3d312f85122a98968d2b32660"} Jul 06 15:18:25.533145 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:25.532745 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:18:25.534102 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:25.534081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tsxrq" event={"ID":"66229ceb-f969-42be-a399-f698f9b35d29","Type":"ContainerStarted","Data":"d489f54072b2919df0738fb7ba54e2e7fc8a31d49ec9929a3acd4d0cc7e19935"} Jul 06 15:18:25.550705 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:25.550667 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n2rxh" podStartSLOduration=66.924616308 podStartE2EDuration="1m11.55064963s" totalImagesPullingTime="4.626033322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:18:25.55010503 +0000 UTC m=+71.860477142" watchObservedRunningTime="2026-07-06 15:18:25.55064963 +0000 UTC m=+71.861021739" Jul 06 15:18:25.570450 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:25.570411 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tsxrq" podStartSLOduration=66.640152118 podStartE2EDuration="1m11.570399988s" totalImagesPullingTime="4.93024787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:18:25.569712344 +0000 UTC m=+71.880084467" watchObservedRunningTime="2026-07-06 15:18:25.570399988 +0000 UTC m=+71.880772098" Jul 06 15:18:53.957220 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:53.957187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") pod \"image-registry-7487f889c8-qzm8j\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:18:53.957591 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:53.957226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:18:53.957591 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:53.957331 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:18:53.957591 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:53.957347 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:18:53.957591 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:53.957397 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls podName:3ac69126-e7ad-4d08-bf6f-f7d0288b61ab nodeName:}" failed. No retries permitted until 2026-07-06 15:19:57.95738481 +0000 UTC m=+164.267756898 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls") pod "dns-default-j8wqz" (UID: "3ac69126-e7ad-4d08-bf6f-f7d0288b61ab") : secret "dns-default-metrics-tls" not found Jul 06 15:18:53.957591 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:53.957349 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7487f889c8-qzm8j: secret "image-registry-tls" not found Jul 06 15:18:53.957591 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:53.957481 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls podName:7cf717bd-88e1-4e21-b9b3-83c653a7d9de nodeName:}" failed. No retries permitted until 2026-07-06 15:19:57.957467185 +0000 UTC m=+164.267839273 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls") pod "image-registry-7487f889c8-qzm8j" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de") : secret "image-registry-tls" not found Jul 06 15:18:56.431153 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.431118 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj"] Jul 06 15:18:56.458132 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.458104 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj"] Jul 06 15:18:56.458269 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.458241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.464894 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.464872 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 15:18:56.465015 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.464871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 15:18:56.465058 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.465034 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wzg7q\"" Jul 06 15:18:56.466269 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.466250 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 15:18:56.466359 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.466268 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 15:18:56.539080 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.539059 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n2rxh" Jul 06 15:18:56.575355 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.575329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.575491 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.575363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.575491 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.575477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbq74\" (UniqueName: \"kubernetes.io/projected/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-kube-api-access-qbq74\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.676439 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.676407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbq74\" (UniqueName: \"kubernetes.io/projected/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-kube-api-access-qbq74\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.676580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.676463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.676580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.676482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.676690 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:56.676590 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 15:18:56.676690 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:56.676667 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls podName:6c021b29-a87e-40d1-832a-b56bc9d6c3cf nodeName:}" failed. No retries permitted until 2026-07-06 15:18:57.176649184 +0000 UTC m=+103.487021276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7t8gj" (UID: "6c021b29-a87e-40d1-832a-b56bc9d6c3cf") : secret "cluster-monitoring-operator-tls" not found Jul 06 15:18:56.677195 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.677178 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:56.685847 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:56.685778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbq74\" (UniqueName: \"kubernetes.io/projected/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-kube-api-access-qbq74\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:57.179636 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:57.179597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:57.179793 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:57.179721 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 15:18:57.179793 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:57.179786 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls podName:6c021b29-a87e-40d1-832a-b56bc9d6c3cf nodeName:}" failed. No retries permitted until 2026-07-06 15:18:58.179770726 +0000 UTC m=+104.490142816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7t8gj" (UID: "6c021b29-a87e-40d1-832a-b56bc9d6c3cf") : secret "cluster-monitoring-operator-tls" not found Jul 06 15:18:58.187571 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:18:58.187541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:18:58.188067 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:58.187664 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 15:18:58.188067 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:18:58.187736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls podName:6c021b29-a87e-40d1-832a-b56bc9d6c3cf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:00.187713765 +0000 UTC m=+106.498085872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7t8gj" (UID: "6c021b29-a87e-40d1-832a-b56bc9d6c3cf") : secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:00.036871 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.036827 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zzhcz"] Jul 06 15:19:00.039286 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.039270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.050546 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.050521 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jul 06 15:19:00.051223 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.051202 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 06 15:19:00.055675 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.055652 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jul 06 15:19:00.063196 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.063166 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 06 15:19:00.063282 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.063251 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-rqfh6\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqfh6\"" type="*v1.Secret" Jul 06 15:19:00.063338 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.063269 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-zzhcz\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" podUID="c7216ac0-2980-4c54-9a72-53051c1e6908" pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.087036 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.087015 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzhcz"] Jul 06 15:19:00.102052 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.102030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2fb6\" (UniqueName: \"kubernetes.io/projected/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-api-access-g2fb6\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.102132 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.102073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7216ac0-2980-4c54-9a72-53051c1e6908-crio-socket\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.102132 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.102090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.102221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.102203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.102256 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.102231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7216ac0-2980-4c54-9a72-53051c1e6908-data-volume\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203430 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:19:00.203430 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7216ac0-2980-4c54-9a72-53051c1e6908-crio-socket\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7216ac0-2980-4c54-9a72-53051c1e6908-data-volume\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7216ac0-2980-4c54-9a72-53051c1e6908-crio-socket\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203580 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.203551 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:00.203771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2fb6\" (UniqueName: \"kubernetes.io/projected/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-api-access-g2fb6\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.203771 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:00.203608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls podName:6c021b29-a87e-40d1-832a-b56bc9d6c3cf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:04.203593452 +0000 UTC m=+110.513965543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7t8gj" (UID: "6c021b29-a87e-40d1-832a-b56bc9d6c3cf") : secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:00.203904 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.203885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7216ac0-2980-4c54-9a72-53051c1e6908-data-volume\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:00.971701 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:00.971673 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 15:19:01.074182 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.074146 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 15:19:01.083916 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.083880 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:19:01.084017 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.083966 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:01.583949301 +0000 UTC m=+107.894321402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : configmap "kube-rbac-proxy" not found Jul 06 15:19:01.127244 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.127211 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqfh6\"" Jul 06 15:19:01.203322 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.203288 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 15:19:01.204379 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.204362 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:19:01.204483 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.204471 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:01.704452294 +0000 UTC m=+108.014824398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : secret "insights-runtime-extractor-tls" not found Jul 06 15:19:01.383215 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.383191 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 15:19:01.393676 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.393652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2fb6\" (UniqueName: \"kubernetes.io/projected/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-api-access-g2fb6\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:01.613248 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.613199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:01.613457 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.613352 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:19:01.613457 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.613429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:02.613410402 +0000 UTC m=+108.923782490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : configmap "kube-rbac-proxy" not found Jul 06 15:19:01.714078 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:01.713987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:01.714220 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.714137 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:19:01.714220 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:01.714197 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:02.714182898 +0000 UTC m=+109.024554986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : secret "insights-runtime-extractor-tls" not found Jul 06 15:19:02.006820 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:02.006796 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4289_f0a1f690-c1ef-424c-88bb-d9996e4ac694/dns-node-resolver/0.log" Jul 06 15:19:02.621547 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:02.621519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:02.621953 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:02.621642 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:19:02.621953 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:02.621710 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:04.621690195 +0000 UTC m=+110.932062303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : configmap "kube-rbac-proxy" not found Jul 06 15:19:02.722649 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:02.722622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:02.722791 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:02.722762 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:19:02.722872 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:02.722858 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:04.722824325 +0000 UTC m=+111.033196413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : secret "insights-runtime-extractor-tls" not found Jul 06 15:19:03.007403 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:03.007381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qxhg_7d1d14f2-41fc-497f-accb-37200a7b7d79/node-ca/0.log" Jul 06 15:19:04.006312 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:04.006261 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x5js5_7fab1e20-88ea-4555-87f2-d3aca283cee6/serve-healthcheck-canary/0.log" Jul 06 15:19:04.233679 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:04.233648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:19:04.233863 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:04.233762 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:04.233863 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:04.233818 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls podName:6c021b29-a87e-40d1-832a-b56bc9d6c3cf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:12.233801937 +0000 UTC m=+118.544174042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7t8gj" (UID: "6c021b29-a87e-40d1-832a-b56bc9d6c3cf") : secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:04.637810 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:04.637777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:04.638003 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:04.637902 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:19:04.638003 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:04.637966 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:08.637950739 +0000 UTC m=+114.948322826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : configmap "kube-rbac-proxy" not found Jul 06 15:19:04.738788 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:04.738747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:04.738932 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:04.738905 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:19:04.738973 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:04.738963 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:08.738949091 +0000 UTC m=+115.049321179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : secret "insights-runtime-extractor-tls" not found Jul 06 15:19:06.250406 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.250367 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68"] Jul 06 15:19:06.252396 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.252379 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.255203 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.255182 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:19:06.255337 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.255240 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 15:19:06.255337 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.255273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9z9xd\"" Jul 06 15:19:06.255337 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.255296 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 15:19:06.264700 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.264678 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68"] Jul 06 15:19:06.351804 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.351781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxdll\" (UniqueName: \"kubernetes.io/projected/34575624-9230-47c5-9b9a-2972ea4c7ecf-kube-api-access-lxdll\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.351963 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.351899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.356278 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.356261 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp"] Jul 06 15:19:06.358020 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.358006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" Jul 06 15:19:06.360758 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.360742 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zbbkc\"" Jul 06 15:19:06.360886 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.360742 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:19:06.360964 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.360945 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 15:19:06.370252 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.370234 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp"] Jul 06 15:19:06.452215 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.452185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4982v\" (UniqueName: \"kubernetes.io/projected/774a2c39-e5f9-417d-a790-20e742abe2a0-kube-api-access-4982v\") pod \"volume-data-source-validator-5d456fdbcd-tncrp\" (UID: \"774a2c39-e5f9-417d-a790-20e742abe2a0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" Jul 06 15:19:06.452215 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.452217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.452425 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.452259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxdll\" (UniqueName: \"kubernetes.io/projected/34575624-9230-47c5-9b9a-2972ea4c7ecf-kube-api-access-lxdll\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.452425 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:06.452349 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 15:19:06.452425 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:06.452413 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls podName:34575624-9230-47c5-9b9a-2972ea4c7ecf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:06.952398478 +0000 UTC m=+113.262770565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-76n68" (UID: "34575624-9230-47c5-9b9a-2972ea4c7ecf") : secret "samples-operator-tls" not found Jul 06 15:19:06.461583 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.461559 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxdll\" (UniqueName: \"kubernetes.io/projected/34575624-9230-47c5-9b9a-2972ea4c7ecf-kube-api-access-lxdll\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.553505 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.553442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4982v\" (UniqueName: \"kubernetes.io/projected/774a2c39-e5f9-417d-a790-20e742abe2a0-kube-api-access-4982v\") pod \"volume-data-source-validator-5d456fdbcd-tncrp\" (UID: \"774a2c39-e5f9-417d-a790-20e742abe2a0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" Jul 06 15:19:06.561957 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.561936 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4982v\" (UniqueName: \"kubernetes.io/projected/774a2c39-e5f9-417d-a790-20e742abe2a0-kube-api-access-4982v\") pod \"volume-data-source-validator-5d456fdbcd-tncrp\" (UID: \"774a2c39-e5f9-417d-a790-20e742abe2a0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" Jul 06 15:19:06.666277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.666254 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" Jul 06 15:19:06.782224 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.782198 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp"] Jul 06 15:19:06.784462 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:06.784436 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774a2c39_e5f9_417d_a790_20e742abe2a0.slice/crio-9c383c12116be5f8320a3e34a22e09e58f3dc54cd4a002f08b579c12e060c315 WatchSource:0}: Error finding container 9c383c12116be5f8320a3e34a22e09e58f3dc54cd4a002f08b579c12e060c315: Status 404 returned error can't find the container with id 9c383c12116be5f8320a3e34a22e09e58f3dc54cd4a002f08b579c12e060c315 Jul 06 15:19:06.957304 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:06.957223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:06.957442 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:06.957359 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 15:19:06.957442 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:06.957429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls podName:34575624-9230-47c5-9b9a-2972ea4c7ecf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:07.957414492 +0000 UTC m=+114.267786579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-76n68" (UID: "34575624-9230-47c5-9b9a-2972ea4c7ecf") : secret "samples-operator-tls" not found Jul 06 15:19:07.636012 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:07.635978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" event={"ID":"774a2c39-e5f9-417d-a790-20e742abe2a0","Type":"ContainerStarted","Data":"9c383c12116be5f8320a3e34a22e09e58f3dc54cd4a002f08b579c12e060c315"} Jul 06 15:19:07.964746 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:07.964673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:07.964918 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:07.964858 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 15:19:07.964986 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:07.964922 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls podName:34575624-9230-47c5-9b9a-2972ea4c7ecf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:09.96490587 +0000 UTC m=+116.275277957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-76n68" (UID: "34575624-9230-47c5-9b9a-2972ea4c7ecf") : secret "samples-operator-tls" not found Jul 06 15:19:08.639978 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:08.639944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" event={"ID":"774a2c39-e5f9-417d-a790-20e742abe2a0","Type":"ContainerStarted","Data":"0ddbf7eca1dd57d5a1f3ec87a38aa734d70dbd324e4fa64b09c607f505f39e6b"} Jul 06 15:19:08.658664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:08.658620 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tncrp" podStartSLOduration=1.305878419 podStartE2EDuration="2.658606824s" totalImagesPullingTime="1.352728405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:08.657932186 +0000 UTC m=+114.968304297" watchObservedRunningTime="2026-07-06 15:19:08.658606824 +0000 UTC m=+114.968978962" Jul 06 15:19:08.670818 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:08.670797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:08.670899 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:08.670876 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:19:08.670935 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:08.670922 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:16.670911193 +0000 UTC m=+122.981283282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : configmap "kube-rbac-proxy" not found Jul 06 15:19:08.771525 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:08.771503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:08.771619 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:08.771608 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:19:08.771661 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:08.771653 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:16.771641821 +0000 UTC m=+123.082013909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : secret "insights-runtime-extractor-tls" not found Jul 06 15:19:09.979426 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:09.979393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:09.979803 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:09.979506 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 15:19:09.979803 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:09.979562 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls podName:34575624-9230-47c5-9b9a-2972ea4c7ecf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:13.979545806 +0000 UTC m=+120.289917897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-76n68" (UID: "34575624-9230-47c5-9b9a-2972ea4c7ecf") : secret "samples-operator-tls" not found Jul 06 15:19:12.297640 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:12.297599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:19:12.298015 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:12.297745 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:12.298015 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:12.297807 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls podName:6c021b29-a87e-40d1-832a-b56bc9d6c3cf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:28.297791602 +0000 UTC m=+134.608163695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7t8gj" (UID: "6c021b29-a87e-40d1-832a-b56bc9d6c3cf") : secret "cluster-monitoring-operator-tls" not found Jul 06 15:19:14.011009 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.010978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:14.011450 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:14.011159 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 15:19:14.011450 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:14.011241 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls podName:34575624-9230-47c5-9b9a-2972ea4c7ecf nodeName:}" failed. No retries permitted until 2026-07-06 15:19:22.01121919 +0000 UTC m=+128.321591297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-76n68" (UID: "34575624-9230-47c5-9b9a-2972ea4c7ecf") : secret "samples-operator-tls" not found Jul 06 15:19:14.608318 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.608278 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dtr8f"] Jul 06 15:19:14.610312 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.610291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.614453 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.614431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 15:19:14.614587 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.614569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d87xx\"" Jul 06 15:19:14.615539 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.615516 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 15:19:14.615631 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.615565 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 15:19:14.615631 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.615555 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 15:19:14.618806 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.618786 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dtr8f"] Jul 06 15:19:14.715707 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.715681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvmqw\" (UniqueName: \"kubernetes.io/projected/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-kube-api-access-qvmqw\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.715899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.715782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-signing-key\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.715899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.715815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-signing-cabundle\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.816375 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.816332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmqw\" (UniqueName: \"kubernetes.io/projected/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-kube-api-access-qvmqw\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.816474 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.816422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-signing-key\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.816474 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.816447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-signing-cabundle\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.817078 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.817058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-signing-cabundle\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.818741 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.818720 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-signing-key\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.825816 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.825797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvmqw\" (UniqueName: \"kubernetes.io/projected/ea74fbff-c8d2-4b83-8cbe-949538a0b63d-kube-api-access-qvmqw\") pod \"service-ca-758f599c5-dtr8f\" (UID: \"ea74fbff-c8d2-4b83-8cbe-949538a0b63d\") " pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:14.923005 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:14.922916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dtr8f" Jul 06 15:19:15.038985 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:15.038957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dtr8f"] Jul 06 15:19:15.041699 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:15.041659 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea74fbff_c8d2_4b83_8cbe_949538a0b63d.slice/crio-469411415ade42d429e8767d0789130312252b87217c96c278ec953fa9428812 WatchSource:0}: Error finding container 469411415ade42d429e8767d0789130312252b87217c96c278ec953fa9428812: Status 404 returned error can't find the container with id 469411415ade42d429e8767d0789130312252b87217c96c278ec953fa9428812 Jul 06 15:19:15.656558 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:15.656523 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dtr8f" event={"ID":"ea74fbff-c8d2-4b83-8cbe-949538a0b63d","Type":"ContainerStarted","Data":"469411415ade42d429e8767d0789130312252b87217c96c278ec953fa9428812"} Jul 06 15:19:16.731661 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:16.731631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:16.732165 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:16.732145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7216ac0-2980-4c54-9a72-53051c1e6908-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:16.833098 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:16.833059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:16.833273 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:16.833235 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:19:16.833348 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:16.833308 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls podName:c7216ac0-2980-4c54-9a72-53051c1e6908 nodeName:}" failed. No retries permitted until 2026-07-06 15:19:32.833289865 +0000 UTC m=+139.143661957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzhcz" (UID: "c7216ac0-2980-4c54-9a72-53051c1e6908") : secret "insights-runtime-extractor-tls" not found Jul 06 15:19:17.663885 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:17.663842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dtr8f" event={"ID":"ea74fbff-c8d2-4b83-8cbe-949538a0b63d","Type":"ContainerStarted","Data":"dc4459a2e2ad0384a75d9d3bc7c0a09e81999f7d8035c6fac9167cf02f3174af"} Jul 06 15:19:17.681659 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:17.681603 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-dtr8f" podStartSLOduration=1.227931758 podStartE2EDuration="3.681586156s" totalImagesPullingTime="2.453654398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:17.680897322 +0000 UTC m=+123.991269429" watchObservedRunningTime="2026-07-06 15:19:17.681586156 +0000 UTC m=+123.991958300" Jul 06 15:19:22.079324 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:22.079283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:22.081522 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:22.081501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34575624-9230-47c5-9b9a-2972ea4c7ecf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-76n68\" (UID: \"34575624-9230-47c5-9b9a-2972ea4c7ecf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:22.163754 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:22.163722 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9z9xd\"" Jul 06 15:19:22.171226 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:22.171211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" Jul 06 15:19:22.291480 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:22.291457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68"] Jul 06 15:19:22.676758 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:22.676674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" event={"ID":"34575624-9230-47c5-9b9a-2972ea4c7ecf","Type":"ContainerStarted","Data":"1e25266f29396bdc35a7b9d84a4ed7b2dc437cb76707aa9aabc537172951ca6d"} Jul 06 15:19:23.994608 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:23.994571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:19:23.995082 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:23.994753 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:19:23.995082 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:23.994866 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs podName:8f670ea7-0a33-4e6f-ba95-2669c07c4e4a nodeName:}" failed. No retries permitted until 2026-07-06 15:21:25.994825063 +0000 UTC m=+252.305197156 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs") pod "network-metrics-daemon-xlgj5" (UID: "8f670ea7-0a33-4e6f-ba95-2669c07c4e4a") : secret "metrics-daemon-secret" not found Jul 06 15:19:24.686774 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:24.686251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" event={"ID":"34575624-9230-47c5-9b9a-2972ea4c7ecf","Type":"ContainerStarted","Data":"d1c05ed4d59cb3212a835c473e71a016fe3e1510011b035848c5af81bdac87f3"} Jul 06 15:19:24.689462 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:24.687054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" event={"ID":"34575624-9230-47c5-9b9a-2972ea4c7ecf","Type":"ContainerStarted","Data":"08cd283455d6bdae2c86a8245cd968526d7905903fc7b57a36010f95a9800a62"} Jul 06 15:19:24.716747 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:24.716702 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-76n68" podStartSLOduration=16.607966527 podStartE2EDuration="18.716687328s" totalImagesPullingTime="2.108720801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:24.716226508 +0000 UTC m=+131.026598619" watchObservedRunningTime="2026-07-06 15:19:24.716687328 +0000 UTC m=+131.027059438" Jul 06 15:19:28.328038 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:28.327999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:19:28.330299 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:28.330267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c021b29-a87e-40d1-832a-b56bc9d6c3cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7t8gj\" (UID: \"6c021b29-a87e-40d1-832a-b56bc9d6c3cf\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:19:28.570271 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:28.570240 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wzg7q\"" Jul 06 15:19:28.577666 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:28.577648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" Jul 06 15:19:28.701268 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:28.701098 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj"] Jul 06 15:19:28.703588 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:28.703557 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c021b29_a87e_40d1_832a_b56bc9d6c3cf.slice/crio-db6a4ae98f4b3c95a91507a8eea0ef97eb8fac52170e91bbcc8535eddefdb056 WatchSource:0}: Error finding container db6a4ae98f4b3c95a91507a8eea0ef97eb8fac52170e91bbcc8535eddefdb056: Status 404 returned error can't find the container with id db6a4ae98f4b3c95a91507a8eea0ef97eb8fac52170e91bbcc8535eddefdb056 Jul 06 15:19:29.704144 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:29.704113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" event={"ID":"6c021b29-a87e-40d1-832a-b56bc9d6c3cf","Type":"ContainerStarted","Data":"db6a4ae98f4b3c95a91507a8eea0ef97eb8fac52170e91bbcc8535eddefdb056"} Jul 06 15:19:31.712038 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:31.711952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" event={"ID":"6c021b29-a87e-40d1-832a-b56bc9d6c3cf","Type":"ContainerStarted","Data":"12cb553c09221c830b849aff79e9c4184dda6ec7adc716b23ddaa630e398700e"} Jul 06 15:19:31.733044 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:31.732987 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" podStartSLOduration=33.157342644 podStartE2EDuration="35.732967073s" totalImagesPullingTime="2.575624429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:31.731454851 +0000 UTC m=+138.041826962" watchObservedRunningTime="2026-07-06 15:19:31.732967073 +0000 UTC m=+138.043339185" Jul 06 15:19:32.866646 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:32.866601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:32.868854 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:32.868819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7216ac0-2980-4c54-9a72-53051c1e6908-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzhcz\" (UID: \"c7216ac0-2980-4c54-9a72-53051c1e6908\") " pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:33.051487 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:33.051457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqfh6\"" Jul 06 15:19:33.058824 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:33.058807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzhcz" Jul 06 15:19:33.180720 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:33.180691 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzhcz"] Jul 06 15:19:33.183590 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:33.183555 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7216ac0_2980_4c54_9a72_53051c1e6908.slice/crio-81361c32fe6c84de0554b6fde86929578dfb9341eeb147505ae0c5afa2f3e486 WatchSource:0}: Error finding container 81361c32fe6c84de0554b6fde86929578dfb9341eeb147505ae0c5afa2f3e486: Status 404 returned error can't find the container with id 81361c32fe6c84de0554b6fde86929578dfb9341eeb147505ae0c5afa2f3e486 Jul 06 15:19:33.722981 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:33.722934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzhcz" event={"ID":"c7216ac0-2980-4c54-9a72-53051c1e6908","Type":"ContainerStarted","Data":"81361c32fe6c84de0554b6fde86929578dfb9341eeb147505ae0c5afa2f3e486"} Jul 06 15:19:35.907516 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.907485 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7487f889c8-qzm8j"] Jul 06 15:19:35.907915 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:35.907700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" podUID="7cf717bd-88e1-4e21-b9b3-83c653a7d9de" Jul 06 15:19:35.925236 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.925210 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq"] Jul 06 15:19:35.930699 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.930677 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq"] Jul 06 15:19:35.930822 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.930809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:35.933959 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.933940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 15:19:35.934157 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.934024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sdh8x\"" Jul 06 15:19:35.934213 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.934186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:35.936931 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.936913 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 15:19:35.937105 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.937093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xzzpt\"" Jul 06 15:19:35.937213 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.937199 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 15:19:35.944674 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.944639 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq"] Jul 06 15:19:35.950419 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.950398 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq"] Jul 06 15:19:35.989195 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.989171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e1085eee-84f1-4a48-b4c1-e77ae33a5ca2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cr6zq\" (UID: \"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:35.989345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.989202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e1085eee-84f1-4a48-b4c1-e77ae33a5ca2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cr6zq\" (UID: \"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:35.989345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:35.989258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee502d02-3d5b-4b4d-933d-0d5ca700e93d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lhdlq\" (UID: \"ee502d02-3d5b-4b4d-933d-0d5ca700e93d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:36.089887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.089850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee502d02-3d5b-4b4d-933d-0d5ca700e93d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lhdlq\" (UID: \"ee502d02-3d5b-4b4d-933d-0d5ca700e93d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:36.090110 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.089958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e1085eee-84f1-4a48-b4c1-e77ae33a5ca2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cr6zq\" (UID: \"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:36.090110 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.089991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e1085eee-84f1-4a48-b4c1-e77ae33a5ca2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cr6zq\" (UID: \"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:36.090801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.090778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e1085eee-84f1-4a48-b4c1-e77ae33a5ca2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cr6zq\" (UID: \"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:36.092589 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.092569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee502d02-3d5b-4b4d-933d-0d5ca700e93d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lhdlq\" (UID: \"ee502d02-3d5b-4b4d-933d-0d5ca700e93d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:36.092715 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.092590 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e1085eee-84f1-4a48-b4c1-e77ae33a5ca2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cr6zq\" (UID: \"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:36.241320 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.241234 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:36.247386 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.247358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" Jul 06 15:19:36.733974 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.733943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:19:36.741089 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.741063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:19:36.796335 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796301 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-bound-sa-token\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796521 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796352 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-trusted-ca\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796595 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796528 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-image-registry-private-configuration\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796595 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796587 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzz2t\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-kube-api-access-hzz2t\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796693 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796619 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-installation-pull-secrets\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796693 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796653 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-ca-trust-extracted\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796693 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796682 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-certificates\") pod \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\" (UID: \"7cf717bd-88e1-4e21-b9b3-83c653a7d9de\") " Jul 06 15:19:36.796951 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796848 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:19:36.797051 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.796924 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:19:36.797262 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.797223 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:19:36.799332 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.799299 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:19:36.799448 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.799390 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-kube-api-access-hzz2t" (OuterVolumeSpecName: "kube-api-access-hzz2t") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "kube-api-access-hzz2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:19:36.799505 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.799452 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:19:36.799567 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.799544 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7cf717bd-88e1-4e21-b9b3-83c653a7d9de" (UID: "7cf717bd-88e1-4e21-b9b3-83c653a7d9de"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898065 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-trusted-ca\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898097 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-image-registry-private-configuration\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898113 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzz2t\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-kube-api-access-hzz2t\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898128 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-installation-pull-secrets\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898143 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-ca-trust-extracted\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898156 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-certificates\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.899584 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.898170 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-bound-sa-token\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:36.986598 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:36.986560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq"] Jul 06 15:19:36.989187 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:36.989163 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1085eee_84f1_4a48_b4c1_e77ae33a5ca2.slice/crio-c14c7a171b06df3044b0912f3c66d3300dfc6f2becf17005f43c160cb885d95c WatchSource:0}: Error finding container c14c7a171b06df3044b0912f3c66d3300dfc6f2becf17005f43c160cb885d95c: Status 404 returned error can't find the container with id c14c7a171b06df3044b0912f3c66d3300dfc6f2becf17005f43c160cb885d95c Jul 06 15:19:37.002365 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.002332 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq"] Jul 06 15:19:37.005029 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:37.005006 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee502d02_3d5b_4b4d_933d_0d5ca700e93d.slice/crio-83983b24cc1d3151a32a876f34b59c22b30b701d0fdb7e65aca6595aa2ac019b WatchSource:0}: Error finding container 83983b24cc1d3151a32a876f34b59c22b30b701d0fdb7e65aca6595aa2ac019b: Status 404 returned error can't find the container with id 83983b24cc1d3151a32a876f34b59c22b30b701d0fdb7e65aca6595aa2ac019b Jul 06 15:19:37.739123 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.739058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" event={"ID":"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2","Type":"ContainerStarted","Data":"c14c7a171b06df3044b0912f3c66d3300dfc6f2becf17005f43c160cb885d95c"} Jul 06 15:19:37.740460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.740434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" event={"ID":"ee502d02-3d5b-4b4d-933d-0d5ca700e93d","Type":"ContainerStarted","Data":"83983b24cc1d3151a32a876f34b59c22b30b701d0fdb7e65aca6595aa2ac019b"} Jul 06 15:19:37.742438 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.742420 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7487f889c8-qzm8j" Jul 06 15:19:37.742572 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.742441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzhcz" event={"ID":"c7216ac0-2980-4c54-9a72-53051c1e6908","Type":"ContainerStarted","Data":"1c9a2e3a76b264f244df7c783428d00f5811e30690f2e49ea43c1de15d9a1e6f"} Jul 06 15:19:37.742572 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.742495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzhcz" event={"ID":"c7216ac0-2980-4c54-9a72-53051c1e6908","Type":"ContainerStarted","Data":"630589be2768258d6c7def7e2e21b7fbc75ecb956853895fbf68314cf22f3898"} Jul 06 15:19:37.780666 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.780610 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7487f889c8-qzm8j"] Jul 06 15:19:37.784277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.784251 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7487f889c8-qzm8j"] Jul 06 15:19:37.805509 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:37.805487 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7cf717bd-88e1-4e21-b9b3-83c653a7d9de-registry-tls\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:19:38.165433 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.165403 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cf717bd-88e1-4e21-b9b3-83c653a7d9de" path="/var/lib/kubelet/pods/7cf717bd-88e1-4e21-b9b3-83c653a7d9de/volumes" Jul 06 15:19:38.749160 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.749118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" event={"ID":"e1085eee-84f1-4a48-b4c1-e77ae33a5ca2","Type":"ContainerStarted","Data":"ae5de9197f0fcae356741753ee15f4a28f65dc8242516082964deab68ee08cab"} Jul 06 15:19:38.751117 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.751091 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" event={"ID":"ee502d02-3d5b-4b4d-933d-0d5ca700e93d","Type":"ContainerStarted","Data":"f597cd98004324b995659fb84151350ab28ac969b2b7ac6b3c1dc9582ab9f026"} Jul 06 15:19:38.751636 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.751613 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:38.757017 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.756994 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" Jul 06 15:19:38.768460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.768415 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cr6zq" podStartSLOduration=2.357482541 podStartE2EDuration="3.768399042s" totalImagesPullingTime="1.410916501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:38.767309659 +0000 UTC m=+145.077681774" watchObservedRunningTime="2026-07-06 15:19:38.768399042 +0000 UTC m=+145.078771154" Jul 06 15:19:38.786107 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.786068 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lhdlq" podStartSLOduration=2.393731224 podStartE2EDuration="3.786055547s" totalImagesPullingTime="1.392324323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:38.785401592 +0000 UTC m=+145.095773715" watchObservedRunningTime="2026-07-06 15:19:38.786055547 +0000 UTC m=+145.096427659" Jul 06 15:19:38.909630 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.909595 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7"] Jul 06 15:19:38.913661 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.913623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:38.917415 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.917285 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 15:19:38.917530 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.917414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 15:19:38.917530 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.917415 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8gdkf\"" Jul 06 15:19:38.917658 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.917577 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 15:19:38.926673 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:38.926646 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7"] Jul 06 15:19:39.013570 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.013490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/59f34d11-e828-4225-b885-e6fe76e93dfd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.013570 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.013532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59f34d11-e828-4225-b885-e6fe76e93dfd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.013794 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.013585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvz6\" (UniqueName: \"kubernetes.io/projected/59f34d11-e828-4225-b885-e6fe76e93dfd-kube-api-access-5dvz6\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.013794 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.013647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f34d11-e828-4225-b885-e6fe76e93dfd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.114752 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.114720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvz6\" (UniqueName: \"kubernetes.io/projected/59f34d11-e828-4225-b885-e6fe76e93dfd-kube-api-access-5dvz6\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.114938 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.114766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f34d11-e828-4225-b885-e6fe76e93dfd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.114938 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.114849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/59f34d11-e828-4225-b885-e6fe76e93dfd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.115068 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.115020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59f34d11-e828-4225-b885-e6fe76e93dfd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.115608 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.115575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f34d11-e828-4225-b885-e6fe76e93dfd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.117547 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.117525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59f34d11-e828-4225-b885-e6fe76e93dfd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.117957 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.117937 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/59f34d11-e828-4225-b885-e6fe76e93dfd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.125055 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.125034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvz6\" (UniqueName: \"kubernetes.io/projected/59f34d11-e828-4225-b885-e6fe76e93dfd-kube-api-access-5dvz6\") pod \"prometheus-operator-567f7b8b7c-tdsb7\" (UID: \"59f34d11-e828-4225-b885-e6fe76e93dfd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.225166 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.225135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" Jul 06 15:19:39.368593 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.368560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7"] Jul 06 15:19:39.371450 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:39.371417 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f34d11_e828_4225_b885_e6fe76e93dfd.slice/crio-cef095b363d88fac634c70c3c8820b232c5683c9348a1c3f220b0769370765dc WatchSource:0}: Error finding container cef095b363d88fac634c70c3c8820b232c5683c9348a1c3f220b0769370765dc: Status 404 returned error can't find the container with id cef095b363d88fac634c70c3c8820b232c5683c9348a1c3f220b0769370765dc Jul 06 15:19:39.755865 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:39.755815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" event={"ID":"59f34d11-e828-4225-b885-e6fe76e93dfd","Type":"ContainerStarted","Data":"cef095b363d88fac634c70c3c8820b232c5683c9348a1c3f220b0769370765dc"} Jul 06 15:19:40.763209 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:40.763130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzhcz" event={"ID":"c7216ac0-2980-4c54-9a72-53051c1e6908","Type":"ContainerStarted","Data":"8ae3064869ad5bf2eeedecafe0a523a2f721dafd739a2e1ca4f5ed72557c0f50"} Jul 06 15:19:40.782368 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:40.782326 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zzhcz" podStartSLOduration=33.602091284 podStartE2EDuration="40.782311377s" totalImagesPullingTime="7.180220093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:19:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:40.781674446 +0000 UTC m=+147.092046557" watchObservedRunningTime="2026-07-06 15:19:40.782311377 +0000 UTC m=+147.092683487" Jul 06 15:19:41.769166 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:41.769064 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" event={"ID":"59f34d11-e828-4225-b885-e6fe76e93dfd","Type":"ContainerStarted","Data":"2a6952eda6b25e7f5a4b449dfebcaf9fb3aa182b46c56f94f90dcb2ab5306b61"} Jul 06 15:19:41.769166 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:41.769130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" event={"ID":"59f34d11-e828-4225-b885-e6fe76e93dfd","Type":"ContainerStarted","Data":"46e159f03fc85a330379210b6ef1b6ae5e7a2098466ff5b58c5001a5eb4ecf20"} Jul 06 15:19:41.790150 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:41.790090 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tdsb7" podStartSLOduration=1.5875371440000001 podStartE2EDuration="3.790070037s" totalImagesPullingTime="2.202532893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:41.788930811 +0000 UTC m=+148.099302934" watchObservedRunningTime="2026-07-06 15:19:41.790070037 +0000 UTC m=+148.100442148" Jul 06 15:19:43.777693 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:43.777659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:19:43.778185 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:43.777704 2579 generic.go:356] "Generic (PLEG): container finished" podID="6c021b29-a87e-40d1-832a-b56bc9d6c3cf" containerID="12cb553c09221c830b849aff79e9c4184dda6ec7adc716b23ddaa630e398700e" exitCode=2 Jul 06 15:19:43.778185 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:43.777740 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" event={"ID":"6c021b29-a87e-40d1-832a-b56bc9d6c3cf","Type":"ContainerDied","Data":"12cb553c09221c830b849aff79e9c4184dda6ec7adc716b23ddaa630e398700e"} Jul 06 15:19:43.778185 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:43.778144 2579 scope.go:117] "RemoveContainer" containerID="12cb553c09221c830b849aff79e9c4184dda6ec7adc716b23ddaa630e398700e" Jul 06 15:19:44.782151 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:44.782127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:19:44.782512 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:44.782176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7t8gj" event={"ID":"6c021b29-a87e-40d1-832a-b56bc9d6c3cf","Type":"ContainerStarted","Data":"0c2f6ab3140999b8c9ea18605519b8ba2810b2bc499465bd97b8bd36a35f8f73"} Jul 06 15:19:47.411012 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.410979 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4"] Jul 06 15:19:47.414175 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.414157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.417160 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.417140 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 15:19:47.417364 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.417349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z4x26\"" Jul 06 15:19:47.417664 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.417650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 15:19:47.429311 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.429289 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4"] Jul 06 15:19:47.433259 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.433239 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5"] Jul 06 15:19:47.436690 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.436674 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.443994 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.440062 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 15:19:47.443994 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.440670 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 15:19:47.443994 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.443129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wnv7b\"" Jul 06 15:19:47.443994 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.443375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 15:19:47.454041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.454018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5"] Jul 06 15:19:47.475749 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc79e247-2bd3-477f-92fa-3ecccc71c06b-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.475887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81e9939d-4051-46d7-8556-b3fba19b07f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.475887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.475887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81e9939d-4051-46d7-8556-b3fba19b07f9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.476054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc79e247-2bd3-477f-92fa-3ecccc71c06b-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.476054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.476054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81e9939d-4051-46d7-8556-b3fba19b07f9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.476054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.475955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs6ft\" (UniqueName: \"kubernetes.io/projected/81e9939d-4051-46d7-8556-b3fba19b07f9-kube-api-access-rs6ft\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.476054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.476013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrf8\" (UniqueName: \"kubernetes.io/projected/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-api-access-4qrf8\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.476301 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.476057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577308 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrf8\" (UniqueName: \"kubernetes.io/projected/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-api-access-4qrf8\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577454 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577454 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc79e247-2bd3-477f-92fa-3ecccc71c06b-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577454 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81e9939d-4051-46d7-8556-b3fba19b07f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.577610 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577674 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81e9939d-4051-46d7-8556-b3fba19b07f9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.577729 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc79e247-2bd3-477f-92fa-3ecccc71c06b-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577729 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.577851 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81e9939d-4051-46d7-8556-b3fba19b07f9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.577851 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.577763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs6ft\" (UniqueName: \"kubernetes.io/projected/81e9939d-4051-46d7-8556-b3fba19b07f9-kube-api-access-rs6ft\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.578161 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:47.578142 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 15:19:47.578381 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:47.578366 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-tls podName:bc79e247-2bd3-477f-92fa-3ecccc71c06b nodeName:}" failed. No retries permitted until 2026-07-06 15:19:48.07834468 +0000 UTC m=+154.388716782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-sfbz5" (UID: "bc79e247-2bd3-477f-92fa-3ecccc71c06b") : secret "kube-state-metrics-tls" not found Jul 06 15:19:47.578501 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.578215 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc79e247-2bd3-477f-92fa-3ecccc71c06b-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.578604 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.578145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc79e247-2bd3-477f-92fa-3ecccc71c06b-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.578707 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.578627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.578902 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.578857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81e9939d-4051-46d7-8556-b3fba19b07f9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.581095 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.580809 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81e9939d-4051-46d7-8556-b3fba19b07f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.581095 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.581023 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81e9939d-4051-46d7-8556-b3fba19b07f9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.581440 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.581421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.592318 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.592292 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs6ft\" (UniqueName: \"kubernetes.io/projected/81e9939d-4051-46d7-8556-b3fba19b07f9-kube-api-access-rs6ft\") pod \"openshift-state-metrics-54cf96dfcf-vxwg4\" (UID: \"81e9939d-4051-46d7-8556-b3fba19b07f9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.593109 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.593092 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrf8\" (UniqueName: \"kubernetes.io/projected/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-api-access-4qrf8\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:47.597775 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.597621 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d8d2x"] Jul 06 15:19:47.602560 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.602543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.605545 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.605525 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 15:19:47.605777 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.605751 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 15:19:47.605948 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.605917 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 15:19:47.606023 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.605989 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7t7r\"" Jul 06 15:19:47.678730 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-sys\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.678730 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-wtmp\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.678944 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-tls\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.678944 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-root\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.678944 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/172a6e65-6d61-4cc1-8eea-fa7a2f103724-metrics-client-ca\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.678944 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.679085 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnm7w\" (UniqueName: \"kubernetes.io/projected/172a6e65-6d61-4cc1-8eea-fa7a2f103724-kube-api-access-nnm7w\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.679085 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.678987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-textfile\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.679085 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.679008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.724718 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.724689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" Jul 06 15:19:47.779865 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.779823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnm7w\" (UniqueName: \"kubernetes.io/projected/172a6e65-6d61-4cc1-8eea-fa7a2f103724-kube-api-access-nnm7w\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.779885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-textfile\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.779912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.779936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-sys\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.779957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-wtmp\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-tls\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780054 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-root\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/172a6e65-6d61-4cc1-8eea-fa7a2f103724-metrics-client-ca\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780486 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-textfile\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780624 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780599 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-root\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780963 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780813 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-wtmp\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780963 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/172a6e65-6d61-4cc1-8eea-fa7a2f103724-sys\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.780963 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.780579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.781200 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.781107 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/172a6e65-6d61-4cc1-8eea-fa7a2f103724-metrics-client-ca\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.783209 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.783169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.783579 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.783553 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/172a6e65-6d61-4cc1-8eea-fa7a2f103724-node-exporter-tls\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.788796 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.788777 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnm7w\" (UniqueName: \"kubernetes.io/projected/172a6e65-6d61-4cc1-8eea-fa7a2f103724-kube-api-access-nnm7w\") pod \"node-exporter-d8d2x\" (UID: \"172a6e65-6d61-4cc1-8eea-fa7a2f103724\") " pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.875661 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.875603 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4"] Jul 06 15:19:47.878236 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:47.878213 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e9939d_4051_46d7_8556_b3fba19b07f9.slice/crio-5d9ef75ee4019d88f55036a0c1542df2d00757dfe2a303f9f695f482344d0980 WatchSource:0}: Error finding container 5d9ef75ee4019d88f55036a0c1542df2d00757dfe2a303f9f695f482344d0980: Status 404 returned error can't find the container with id 5d9ef75ee4019d88f55036a0c1542df2d00757dfe2a303f9f695f482344d0980 Jul 06 15:19:47.911665 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:47.911642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8d2x" Jul 06 15:19:47.927953 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:47.927927 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172a6e65_6d61_4cc1_8eea_fa7a2f103724.slice/crio-3f6b86ddd13826a5132e6be298bdc59bd9a132d7b6f6e5000d1ce460c83a8856 WatchSource:0}: Error finding container 3f6b86ddd13826a5132e6be298bdc59bd9a132d7b6f6e5000d1ce460c83a8856: Status 404 returned error can't find the container with id 3f6b86ddd13826a5132e6be298bdc59bd9a132d7b6f6e5000d1ce460c83a8856 Jul 06 15:19:48.082259 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.082225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:48.084492 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.084461 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc79e247-2bd3-477f-92fa-3ecccc71c06b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-sfbz5\" (UID: \"bc79e247-2bd3-477f-92fa-3ecccc71c06b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:48.348527 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.348493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" Jul 06 15:19:48.479248 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.479218 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5"] Jul 06 15:19:48.482193 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:48.482157 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc79e247_2bd3_477f_92fa_3ecccc71c06b.slice/crio-1560008ad4ac56e553a4de6c825e75c3f39e60426d0b07a4e1024e5856dbef06 WatchSource:0}: Error finding container 1560008ad4ac56e553a4de6c825e75c3f39e60426d0b07a4e1024e5856dbef06: Status 404 returned error can't find the container with id 1560008ad4ac56e553a4de6c825e75c3f39e60426d0b07a4e1024e5856dbef06 Jul 06 15:19:48.590026 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.589950 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:19:48.594904 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.594880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.597744 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.597705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 15:19:48.597868 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.597793 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 15:19:48.598075 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598056 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 15:19:48.598226 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598160 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 15:19:48.598321 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 15:19:48.598619 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 15:19:48.598619 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598605 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8rss4\"" Jul 06 15:19:48.598810 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598749 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 15:19:48.598810 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.598764 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 15:19:48.599711 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.599539 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 15:19:48.616966 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.616943 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:19:48.687475 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687649 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687649 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687649 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-web-config\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687649 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-config-out\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.687899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.688205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ffp\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-kube-api-access-59ffp\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.688205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.687932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788406 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788592 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-web-config\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788592 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788592 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-config-out\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788592 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ffp\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-kube-api-access-59ffp\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.788793 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.789176 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.788811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.789176 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:48.789005 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 15:19:48.789176 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:48.789076 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls podName:b284344c-6d96-4852-89bc-e84ae42d603e nodeName:}" failed. No retries permitted until 2026-07-06 15:19:49.289055007 +0000 UTC m=+155.599427119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e") : secret "alertmanager-main-tls" not found Jul 06 15:19:48.791891 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.789953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.791891 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.790604 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.792118 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.791399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.793569 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.793545 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-config-out\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.794109 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.794086 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.794856 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.794525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.794856 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.794820 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.795431 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.794911 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-web-config\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.795431 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.795330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.795638 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.795596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.796150 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.796116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.811667 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.807778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ffp\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-kube-api-access-59ffp\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:48.811667 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.809436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" event={"ID":"bc79e247-2bd3-477f-92fa-3ecccc71c06b","Type":"ContainerStarted","Data":"1560008ad4ac56e553a4de6c825e75c3f39e60426d0b07a4e1024e5856dbef06"} Jul 06 15:19:48.811844 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.811722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8d2x" event={"ID":"172a6e65-6d61-4cc1-8eea-fa7a2f103724","Type":"ContainerStarted","Data":"3f6b86ddd13826a5132e6be298bdc59bd9a132d7b6f6e5000d1ce460c83a8856"} Jul 06 15:19:48.818001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.817941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" event={"ID":"81e9939d-4051-46d7-8556-b3fba19b07f9","Type":"ContainerStarted","Data":"17b6fab393069d8456a7827c4136bcee9cf91150aec2230cfe27ff4131172e9b"} Jul 06 15:19:48.818001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.817998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" event={"ID":"81e9939d-4051-46d7-8556-b3fba19b07f9","Type":"ContainerStarted","Data":"9f4e06c38c7eeba8f422d779a6f75d4d9f0b5989bbcfe89f0e5fe2adf89d6b23"} Jul 06 15:19:48.818180 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:48.818027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" event={"ID":"81e9939d-4051-46d7-8556-b3fba19b07f9","Type":"ContainerStarted","Data":"5d9ef75ee4019d88f55036a0c1542df2d00757dfe2a303f9f695f482344d0980"} Jul 06 15:19:49.294625 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:49.294566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:49.299127 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:49.299098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:49.515606 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:49.515571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:19:49.873670 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:49.873515 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:19:49.883224 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:49.883173 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb284344c_6d96_4852_89bc_e84ae42d603e.slice/crio-d7d396a3918f3df8081c90b3f697a4d8d60af3a88045bc9d9f55b1d95ba9641e WatchSource:0}: Error finding container d7d396a3918f3df8081c90b3f697a4d8d60af3a88045bc9d9f55b1d95ba9641e: Status 404 returned error can't find the container with id d7d396a3918f3df8081c90b3f697a4d8d60af3a88045bc9d9f55b1d95ba9641e Jul 06 15:19:50.499296 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.499267 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7944d9d444-lh4lk"] Jul 06 15:19:50.503207 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.503183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.505926 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.505899 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 15:19:50.506133 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.505968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t7mm9\"" Jul 06 15:19:50.506133 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.505983 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 15:19:50.506284 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.506268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 15:19:50.506351 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.506334 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 15:19:50.506408 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.506380 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 15:19:50.506459 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.506442 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e9gn3etpc8rar\"" Jul 06 15:19:50.515476 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.515454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7944d9d444-lh4lk"] Jul 06 15:19:50.607606 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607606 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-tls\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxq8\" (UniqueName: \"kubernetes.io/projected/b471a00a-90bc-457f-8bc1-e59da41d52b5-kube-api-access-qhxq8\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b471a00a-90bc-457f-8bc1-e59da41d52b5-metrics-client-ca\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.607965 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.607862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-grpc-tls\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709020 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.708993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-tls\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709169 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxq8\" (UniqueName: \"kubernetes.io/projected/b471a00a-90bc-457f-8bc1-e59da41d52b5-kube-api-access-qhxq8\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709169 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709169 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b471a00a-90bc-457f-8bc1-e59da41d52b5-metrics-client-ca\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709342 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709342 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-grpc-tls\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709342 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.709342 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.709283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.710335 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.710287 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b471a00a-90bc-457f-8bc1-e59da41d52b5-metrics-client-ca\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.712127 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.712099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.712246 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.712198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-tls\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.712649 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.712629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-grpc-tls\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.712789 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.712768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.712875 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.712855 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.714018 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.713997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b471a00a-90bc-457f-8bc1-e59da41d52b5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.718601 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.718581 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxq8\" (UniqueName: \"kubernetes.io/projected/b471a00a-90bc-457f-8bc1-e59da41d52b5-kube-api-access-qhxq8\") pod \"thanos-querier-7944d9d444-lh4lk\" (UID: \"b471a00a-90bc-457f-8bc1-e59da41d52b5\") " pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.813890 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.813807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:50.829284 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.829201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" event={"ID":"81e9939d-4051-46d7-8556-b3fba19b07f9","Type":"ContainerStarted","Data":"2517d2ce6f3b84404ba325c7b65dade3fc45f026e6e0abba56c5e887b2ab528e"} Jul 06 15:19:50.834040 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.833952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" event={"ID":"bc79e247-2bd3-477f-92fa-3ecccc71c06b","Type":"ContainerStarted","Data":"24cbf333a83abb3bfd4da7a20a83bbc973bade5aa5dd8c6d0546992f6673cb97"} Jul 06 15:19:50.834040 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.834009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" event={"ID":"bc79e247-2bd3-477f-92fa-3ecccc71c06b","Type":"ContainerStarted","Data":"0c063b6144e1946021349fbecfaf68a55475cffe9f5d01b6fc27cb235473d140"} Jul 06 15:19:50.834040 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.834036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" event={"ID":"bc79e247-2bd3-477f-92fa-3ecccc71c06b","Type":"ContainerStarted","Data":"b1129a790a14ba948a52da6f99694c43ed6ce2ea9183708f1e6f2be7de3deb7d"} Jul 06 15:19:50.836361 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.836324 2579 generic.go:356] "Generic (PLEG): container finished" podID="172a6e65-6d61-4cc1-8eea-fa7a2f103724" containerID="176c72112791f61a4bd988c271daec688633599eaa54b63601a0b45e2c43f3c3" exitCode=0 Jul 06 15:19:50.836475 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.836408 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8d2x" event={"ID":"172a6e65-6d61-4cc1-8eea-fa7a2f103724","Type":"ContainerDied","Data":"176c72112791f61a4bd988c271daec688633599eaa54b63601a0b45e2c43f3c3"} Jul 06 15:19:50.839436 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.839399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"d7d396a3918f3df8081c90b3f697a4d8d60af3a88045bc9d9f55b1d95ba9641e"} Jul 06 15:19:50.850449 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.850403 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-vxwg4" podStartSLOduration=2.134083365 podStartE2EDuration="3.8503822s" totalImagesPullingTime="1.716298835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:50.849365424 +0000 UTC m=+157.159737537" watchObservedRunningTime="2026-07-06 15:19:50.8503822 +0000 UTC m=+157.160754312" Jul 06 15:19:50.891267 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.890148 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-sfbz5" podStartSLOduration=2.596543398 podStartE2EDuration="3.890129216s" totalImagesPullingTime="1.293585818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:50.889681036 +0000 UTC m=+157.200053147" watchObservedRunningTime="2026-07-06 15:19:50.890129216 +0000 UTC m=+157.200501326" Jul 06 15:19:50.985816 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:50.985788 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7944d9d444-lh4lk"] Jul 06 15:19:50.989606 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:50.989577 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb471a00a_90bc_457f_8bc1_e59da41d52b5.slice/crio-40fda7cc5a4b767a65a9fd4436dd85b8d1ebb69ccbcf031760ae99108cc6e80f WatchSource:0}: Error finding container 40fda7cc5a4b767a65a9fd4436dd85b8d1ebb69ccbcf031760ae99108cc6e80f: Status 404 returned error can't find the container with id 40fda7cc5a4b767a65a9fd4436dd85b8d1ebb69ccbcf031760ae99108cc6e80f Jul 06 15:19:51.847489 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:51.847440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8d2x" event={"ID":"172a6e65-6d61-4cc1-8eea-fa7a2f103724","Type":"ContainerStarted","Data":"a60dfc818e728cfb6b231e60e46133e4f79e9e767ce672d1b692d4119192bd5f"} Jul 06 15:19:51.847961 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:51.847549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8d2x" event={"ID":"172a6e65-6d61-4cc1-8eea-fa7a2f103724","Type":"ContainerStarted","Data":"14473ce9c35f9f9d4c43548ca0630d01a00c0c1bc631fe944421dac8b4efff96"} Jul 06 15:19:51.849454 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:51.849427 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="92eb8e97ae83238d15ac2ef7fb4a604af810ec318fb1d008ec713a3102e35e72" exitCode=0 Jul 06 15:19:51.849592 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:51.849508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"92eb8e97ae83238d15ac2ef7fb4a604af810ec318fb1d008ec713a3102e35e72"} Jul 06 15:19:51.850897 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:51.850867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"40fda7cc5a4b767a65a9fd4436dd85b8d1ebb69ccbcf031760ae99108cc6e80f"} Jul 06 15:19:51.876558 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:51.876512 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d8d2x" podStartSLOduration=2.99167242 podStartE2EDuration="4.876498229s" totalImagesPullingTime="1.800862706s" totalInitContainerRuntime="83.963103ms" isStatefulPod=true podCreationTimestamp="2026-07-06 15:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:51.874813647 +0000 UTC m=+158.185185770" watchObservedRunningTime="2026-07-06 15:19:51.876498229 +0000 UTC m=+158.186870357" Jul 06 15:19:52.703472 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.703437 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-648fd75d6c-g8m97"] Jul 06 15:19:52.707437 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.707413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.710865 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.710822 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fjqws\"" Jul 06 15:19:52.710996 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.710914 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 15:19:52.711411 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.711387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 15:19:52.711522 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.711485 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 15:19:52.711843 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.711811 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 15:19:52.711936 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.711811 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 15:19:52.718120 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.718098 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 15:19:52.729155 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.729136 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-648fd75d6c-g8m97"] Jul 06 15:19:52.827745 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.827694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-telemeter-client-tls\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.827745 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.827745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-serving-certs-ca-bundle\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.828193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.827808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-metrics-client-ca\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.828193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.827870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-federate-client-tls\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.828193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.827894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crnlt\" (UniqueName: \"kubernetes.io/projected/97013c50-151a-41f5-97d0-9e1239aa3b97-kube-api-access-crnlt\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.828193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.827972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.828193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.828008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.828193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.828075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-secret-telemeter-client\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.930059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.929778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.930059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.929826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.930059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.929884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-secret-telemeter-client\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.930059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.929961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-telemeter-client-tls\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.930059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.929997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-serving-certs-ca-bundle\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.930059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.930062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-metrics-client-ca\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.931127 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.930129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-federate-client-tls\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.931127 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.930157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crnlt\" (UniqueName: \"kubernetes.io/projected/97013c50-151a-41f5-97d0-9e1239aa3b97-kube-api-access-crnlt\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.931301 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.931221 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-metrics-client-ca\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.932920 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.932334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-serving-certs-ca-bundle\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.932920 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.932561 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97013c50-151a-41f5-97d0-9e1239aa3b97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.936282 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.936237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.937961 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.937927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-secret-telemeter-client\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.938133 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.937972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-federate-client-tls\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.938714 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.938655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/97013c50-151a-41f5-97d0-9e1239aa3b97-telemeter-client-tls\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:52.940949 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:52.940923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crnlt\" (UniqueName: \"kubernetes.io/projected/97013c50-151a-41f5-97d0-9e1239aa3b97-kube-api-access-crnlt\") pod \"telemeter-client-648fd75d6c-g8m97\" (UID: \"97013c50-151a-41f5-97d0-9e1239aa3b97\") " pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:53.020476 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:53.020441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" Jul 06 15:19:53.065970 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:53.065934 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j8wqz" podUID="3ac69126-e7ad-4d08-bf6f-f7d0288b61ab" Jul 06 15:19:53.182580 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:19:53.182536 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xlgj5" podUID="8f670ea7-0a33-4e6f-ba95-2669c07c4e4a" Jul 06 15:19:53.860968 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:53.860542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8wqz" Jul 06 15:19:54.047912 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.044423 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-648fd75d6c-g8m97"] Jul 06 15:19:54.868765 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.868724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"62a68c9326f1ed243689976c11e37d0e2fbe599f4e7423e21639f7731ff60df2"} Jul 06 15:19:54.868968 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.868799 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"e00c3ac19d64663dce115aedd46fa1826d1d610f2ed193f14b03d92543919d16"} Jul 06 15:19:54.868968 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.868825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"6f922f3d333b5a8497d76d8c535fdd6037505192781253f0083b22eb4f63e735"} Jul 06 15:19:54.868968 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.868886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"01788270703ab595c500f232abcdab548116a903bab663b8e5052aa70bff97cc"} Jul 06 15:19:54.868968 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.868925 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"fc359bf63ff24f42eb9890518171e778b9031a9bc280dd6c858d6db7512db1a2"} Jul 06 15:19:54.871096 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.871058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"21639428f04ab4ebb531e632f9d2b3e68e099ca9e708fb1dd2587d316c5842fe"} Jul 06 15:19:54.871226 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.871151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"2645af8962a93016b0e10d737d08d18191f43efa147223bc775d290446932442"} Jul 06 15:19:54.871226 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.871194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"605b2064ac8d663d68a236343d06ca15815f8f37f2034d292f7a511b16635f69"} Jul 06 15:19:54.872194 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:54.872170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" event={"ID":"97013c50-151a-41f5-97d0-9e1239aa3b97","Type":"ContainerStarted","Data":"a7dd0ff77e5de4a9ce73f8f7b7a2aa943152b2ee7517caff272f5ede4aff4fee"} Jul 06 15:19:55.880065 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:55.880023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerStarted","Data":"28f411ae54bb01d3a3354b06e34253a657a564d4e783126175e3b0a3bedbe5e5"} Jul 06 15:19:55.883312 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:55.883282 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"940626f00563569173fec9cb2a44678a05516b8e9f9227705c6ed06114317f98"} Jul 06 15:19:55.883424 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:55.883346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"2c3d6659ec28a1beac51a7fa2208be5fcec242594db2f829a41b4d729906159d"} Jul 06 15:19:55.883424 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:55.883386 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:19:55.883424 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:55.883411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" event={"ID":"b471a00a-90bc-457f-8bc1-e59da41d52b5","Type":"ContainerStarted","Data":"67a3f826168178d640314c4106a39c29375f5a951dc4ecc23459edbe0c0a52b4"} Jul 06 15:19:55.913916 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:55.913869 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.381705162 podStartE2EDuration="7.913852336s" totalImagesPullingTime="4.515753965s" totalInitContainerRuntime="16.393209ms" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:55.913269794 +0000 UTC m=+162.223641906" watchObservedRunningTime="2026-07-06 15:19:55.913852336 +0000 UTC m=+162.224224437" Jul 06 15:19:56.889511 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:56.889474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" event={"ID":"97013c50-151a-41f5-97d0-9e1239aa3b97","Type":"ContainerStarted","Data":"df15d3f3a1c2b94648d598d379c846e4cff708e609d82e6cd6e0c6112a76858d"} Jul 06 15:19:56.889998 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:56.889531 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" event={"ID":"97013c50-151a-41f5-97d0-9e1239aa3b97","Type":"ContainerStarted","Data":"abd3f3a24a3e1282a048461c7ba0ee5c235a37f7af66383afe6c3ca03fcc0f76"} Jul 06 15:19:56.889998 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:56.889550 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" event={"ID":"97013c50-151a-41f5-97d0-9e1239aa3b97","Type":"ContainerStarted","Data":"ffc7ee4b536edbaac20ff8ae9da4aa546aa69f924264f6138af458af27f096f1"} Jul 06 15:19:56.917005 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:56.916945 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-648fd75d6c-g8m97" podStartSLOduration=2.742991891 podStartE2EDuration="4.916930549s" totalImagesPullingTime="2.173938658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:56.915939575 +0000 UTC m=+163.226311686" watchObservedRunningTime="2026-07-06 15:19:56.916930549 +0000 UTC m=+163.227302659" Jul 06 15:19:56.918050 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:56.918017 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" podStartSLOduration=2.973493068 podStartE2EDuration="6.918003725s" totalImagesPullingTime="3.944510657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:19:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:19:55.952385798 +0000 UTC m=+162.262757909" watchObservedRunningTime="2026-07-06 15:19:56.918003725 +0000 UTC m=+163.228375835" Jul 06 15:19:57.976288 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:57.976257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:19:57.979121 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:57.979094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ac69126-e7ad-4d08-bf6f-f7d0288b61ab-metrics-tls\") pod \"dns-default-j8wqz\" (UID: \"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab\") " pod="openshift-dns/dns-default-j8wqz" Jul 06 15:19:58.064460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:58.064424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8l7xg\"" Jul 06 15:19:58.072471 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:58.072449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8wqz" Jul 06 15:19:58.224461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:58.224433 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8wqz"] Jul 06 15:19:58.226938 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:19:58.226843 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac69126_e7ad_4d08_bf6f_f7d0288b61ab.slice/crio-5878ecce06e0361f8ab5325cbee8f16d4da720f54c9e32f46be2e1e6bdee8427 WatchSource:0}: Error finding container 5878ecce06e0361f8ab5325cbee8f16d4da720f54c9e32f46be2e1e6bdee8427: Status 404 returned error can't find the container with id 5878ecce06e0361f8ab5325cbee8f16d4da720f54c9e32f46be2e1e6bdee8427 Jul 06 15:19:58.902497 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:19:58.902453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8wqz" event={"ID":"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab","Type":"ContainerStarted","Data":"5878ecce06e0361f8ab5325cbee8f16d4da720f54c9e32f46be2e1e6bdee8427"} Jul 06 15:20:00.912169 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:00.912134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8wqz" event={"ID":"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab","Type":"ContainerStarted","Data":"b525805b3fd1e00c76a877cf3ec93b3603a3aa7867fa054d7c645a2798baa896"} Jul 06 15:20:00.912565 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:00.912187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8wqz" event={"ID":"3ac69126-e7ad-4d08-bf6f-f7d0288b61ab","Type":"ContainerStarted","Data":"39813ff2d18b3131d308691c93cfb72a96915149b45954ebfe95268c7b8eb693"} Jul 06 15:20:00.912565 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:00.912253 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j8wqz" Jul 06 15:20:00.933348 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:00.933305 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j8wqz" podStartSLOduration=129.069181309 podStartE2EDuration="2m10.933292328s" totalImagesPullingTime="1.864111019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:20:00.932650539 +0000 UTC m=+167.243022651" watchObservedRunningTime="2026-07-06 15:20:00.933292328 +0000 UTC m=+167.243664438" Jul 06 15:20:01.895113 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:01.895085 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7944d9d444-lh4lk" Jul 06 15:20:03.044276 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.044233 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-lj56n"] Jul 06 15:20:03.048152 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.048127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:03.055383 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.055365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lgng6\"" Jul 06 15:20:03.055689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.055677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 15:20:03.055903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.055888 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 15:20:03.066387 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.066366 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-lj56n"] Jul 06 15:20:03.123910 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.123872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szlqp\" (UniqueName: \"kubernetes.io/projected/3205d4ba-455a-4490-bf13-d632c0588792-kube-api-access-szlqp\") pod \"downloads-685bfb5f64-lj56n\" (UID: \"3205d4ba-455a-4490-bf13-d632c0588792\") " pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:03.224803 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.224773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szlqp\" (UniqueName: \"kubernetes.io/projected/3205d4ba-455a-4490-bf13-d632c0588792-kube-api-access-szlqp\") pod \"downloads-685bfb5f64-lj56n\" (UID: \"3205d4ba-455a-4490-bf13-d632c0588792\") " pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:03.239251 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.239222 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szlqp\" (UniqueName: \"kubernetes.io/projected/3205d4ba-455a-4490-bf13-d632c0588792-kube-api-access-szlqp\") pod \"downloads-685bfb5f64-lj56n\" (UID: \"3205d4ba-455a-4490-bf13-d632c0588792\") " pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:03.356960 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.356879 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:03.488166 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.488081 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-lj56n"] Jul 06 15:20:03.491002 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:20:03.490975 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3205d4ba_455a_4490_bf13_d632c0588792.slice/crio-aff35a9146122f3280a4b5675d76ae0fb0a732be3343a8dd1497a45d7919ce21 WatchSource:0}: Error finding container aff35a9146122f3280a4b5675d76ae0fb0a732be3343a8dd1497a45d7919ce21: Status 404 returned error can't find the container with id aff35a9146122f3280a4b5675d76ae0fb0a732be3343a8dd1497a45d7919ce21 Jul 06 15:20:03.925970 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:03.925932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-lj56n" event={"ID":"3205d4ba-455a-4490-bf13-d632c0588792","Type":"ContainerStarted","Data":"aff35a9146122f3280a4b5675d76ae0fb0a732be3343a8dd1497a45d7919ce21"} Jul 06 15:20:06.160643 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:06.160557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:20:10.918799 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:10.918764 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j8wqz" Jul 06 15:20:14.876027 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.875991 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66cc8cdf4b-4rzrb"] Jul 06 15:20:14.878987 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.878963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:14.884513 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.884482 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 15:20:14.884513 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.884493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 15:20:14.886032 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.885906 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7fhr8\"" Jul 06 15:20:14.886175 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.886157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 15:20:14.886245 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.886206 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 15:20:14.886307 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.886210 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 15:20:14.903483 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.903465 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cc8cdf4b-4rzrb"] Jul 06 15:20:14.934974 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.934941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-console-config\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:14.935117 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.934998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-oauth-serving-cert\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:14.935117 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.935032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvck\" (UniqueName: \"kubernetes.io/projected/768b9396-fa1d-46ba-be13-1230f4d971fb-kube-api-access-8gvck\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:14.935117 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.935107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-oauth-config\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:14.935269 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.935147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-serving-cert\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:14.935269 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:14.935186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-service-ca\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.036570 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.036532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-oauth-config\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.036751 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.036584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-serving-cert\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.036751 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.036621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-service-ca\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.036751 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.036700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-console-config\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.036751 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.036739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-oauth-serving-cert\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.036981 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.036765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvck\" (UniqueName: \"kubernetes.io/projected/768b9396-fa1d-46ba-be13-1230f4d971fb-kube-api-access-8gvck\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.037561 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.037503 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-console-config\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.037561 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.037552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-service-ca\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.037766 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.037612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-oauth-serving-cert\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.039250 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.039230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-serving-cert\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.039371 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.039355 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-oauth-config\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.047145 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.047122 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvck\" (UniqueName: \"kubernetes.io/projected/768b9396-fa1d-46ba-be13-1230f4d971fb-kube-api-access-8gvck\") pod \"console-66cc8cdf4b-4rzrb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:15.190452 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:15.190371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:21.207140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:21.207118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cc8cdf4b-4rzrb"] Jul 06 15:20:21.209672 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:20:21.209638 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768b9396_fa1d_46ba_be13_1230f4d971fb.slice/crio-ee35fa6d324affef97f22a812ac1948414e3eb1a8325e9e0a7c0c258acc9a2bc WatchSource:0}: Error finding container ee35fa6d324affef97f22a812ac1948414e3eb1a8325e9e0a7c0c258acc9a2bc: Status 404 returned error can't find the container with id ee35fa6d324affef97f22a812ac1948414e3eb1a8325e9e0a7c0c258acc9a2bc Jul 06 15:20:21.930409 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:21.930371 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cd6c9b48b-mf9zx"] Jul 06 15:20:21.934689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:21.934665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:21.947726 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:21.947687 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 15:20:21.951385 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:21.951364 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd6c9b48b-mf9zx"] Jul 06 15:20:22.005384 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-serving-cert\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.005588 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-oauth-config\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.005588 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-oauth-serving-cert\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.005588 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgvm\" (UniqueName: \"kubernetes.io/projected/fcf49c4c-9871-419c-a366-6abe6109fd43-kube-api-access-zwgvm\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.005801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-console-config\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.005801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-trusted-ca-bundle\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.005801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.005696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-service-ca\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.012095 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.012028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-lj56n" event={"ID":"3205d4ba-455a-4490-bf13-d632c0588792","Type":"ContainerStarted","Data":"ff34d46849cdf4f7d1fa3925bc228b514ad3f7a62d3638e61e543aa9f2ddc7fe"} Jul 06 15:20:22.012428 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.012408 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:22.014008 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.013980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc8cdf4b-4rzrb" event={"ID":"768b9396-fa1d-46ba-be13-1230f4d971fb","Type":"ContainerStarted","Data":"ee35fa6d324affef97f22a812ac1948414e3eb1a8325e9e0a7c0c258acc9a2bc"} Jul 06 15:20:22.030254 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.030215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-lj56n" Jul 06 15:20:22.070472 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.065889 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-lj56n" podStartSLOduration=1.393420612 podStartE2EDuration="19.065867179s" totalImagesPullingTime="17.672446567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:20:22.03490808 +0000 UTC m=+188.345280191" watchObservedRunningTime="2026-07-06 15:20:22.065867179 +0000 UTC m=+188.376239287" Jul 06 15:20:22.107213 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-oauth-serving-cert\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.107450 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgvm\" (UniqueName: \"kubernetes.io/projected/fcf49c4c-9871-419c-a366-6abe6109fd43-kube-api-access-zwgvm\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.107580 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-console-config\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.107693 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-trusted-ca-bundle\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.107693 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-service-ca\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.107812 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-serving-cert\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.107812 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.107758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-oauth-config\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.108070 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.108043 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-oauth-serving-cert\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.108533 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.108249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-console-config\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.108695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.108668 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-service-ca\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.109009 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.108985 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-trusted-ca-bundle\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.111205 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.111179 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-serving-cert\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.111306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.111216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-oauth-config\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.119461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.119436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgvm\" (UniqueName: \"kubernetes.io/projected/fcf49c4c-9871-419c-a366-6abe6109fd43-kube-api-access-zwgvm\") pod \"console-6cd6c9b48b-mf9zx\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.247912 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.247879 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:22.426974 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:22.426621 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd6c9b48b-mf9zx"] Jul 06 15:20:22.431943 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:20:22.431865 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf49c4c_9871_419c_a366_6abe6109fd43.slice/crio-f4ce5411e5e0b0a7008e75e73ea887a86e75c7bcd9b006e6ed891c7d85979d69 WatchSource:0}: Error finding container f4ce5411e5e0b0a7008e75e73ea887a86e75c7bcd9b006e6ed891c7d85979d69: Status 404 returned error can't find the container with id f4ce5411e5e0b0a7008e75e73ea887a86e75c7bcd9b006e6ed891c7d85979d69 Jul 06 15:20:23.023020 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:23.022909 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd6c9b48b-mf9zx" event={"ID":"fcf49c4c-9871-419c-a366-6abe6109fd43","Type":"ContainerStarted","Data":"f4ce5411e5e0b0a7008e75e73ea887a86e75c7bcd9b006e6ed891c7d85979d69"} Jul 06 15:20:27.045192 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:27.045155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc8cdf4b-4rzrb" event={"ID":"768b9396-fa1d-46ba-be13-1230f4d971fb","Type":"ContainerStarted","Data":"a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f"} Jul 06 15:20:27.047130 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:27.047100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd6c9b48b-mf9zx" event={"ID":"fcf49c4c-9871-419c-a366-6abe6109fd43","Type":"ContainerStarted","Data":"cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d"} Jul 06 15:20:27.074006 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:27.073957 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66cc8cdf4b-4rzrb" podStartSLOduration=8.244402181 podStartE2EDuration="13.073942237s" totalImagesPullingTime="4.829540056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:20:27.073105865 +0000 UTC m=+193.383477976" watchObservedRunningTime="2026-07-06 15:20:27.073942237 +0000 UTC m=+193.384314347" Jul 06 15:20:32.248885 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:32.248851 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:32.249511 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:32.248906 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:32.253403 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:32.253381 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:32.285432 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:32.285384 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cd6c9b48b-mf9zx" podStartSLOduration=7.543296301 podStartE2EDuration="11.285371513s" totalImagesPullingTime="3.742075212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:20:27.104057032 +0000 UTC m=+193.414429141" watchObservedRunningTime="2026-07-06 15:20:32.285371513 +0000 UTC m=+198.595743624" Jul 06 15:20:33.079094 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:33.079058 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:20:33.153146 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:33.153115 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66cc8cdf4b-4rzrb"] Jul 06 15:20:35.191345 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:35.191311 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:58.173440 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.173396 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66cc8cdf4b-4rzrb" podUID="768b9396-fa1d-46ba-be13-1230f4d971fb" containerName="console" containerID="cri-o://a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f" gracePeriod=15 Jul 06 15:20:58.455199 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.455156 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:58.516101 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516072 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gvck\" (UniqueName: \"kubernetes.io/projected/768b9396-fa1d-46ba-be13-1230f4d971fb-kube-api-access-8gvck\") pod \"768b9396-fa1d-46ba-be13-1230f4d971fb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " Jul 06 15:20:58.516223 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516118 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-oauth-serving-cert\") pod \"768b9396-fa1d-46ba-be13-1230f4d971fb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " Jul 06 15:20:58.516223 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516149 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-console-config\") pod \"768b9396-fa1d-46ba-be13-1230f4d971fb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " Jul 06 15:20:58.516223 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516183 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-serving-cert\") pod \"768b9396-fa1d-46ba-be13-1230f4d971fb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " Jul 06 15:20:58.516223 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516209 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-service-ca\") pod \"768b9396-fa1d-46ba-be13-1230f4d971fb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " Jul 06 15:20:58.516418 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516287 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-oauth-config\") pod \"768b9396-fa1d-46ba-be13-1230f4d971fb\" (UID: \"768b9396-fa1d-46ba-be13-1230f4d971fb\") " Jul 06 15:20:58.516473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516447 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "768b9396-fa1d-46ba-be13-1230f4d971fb" (UID: "768b9396-fa1d-46ba-be13-1230f4d971fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:20:58.516563 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516540 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-oauth-serving-cert\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:20:58.516640 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516618 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-console-config" (OuterVolumeSpecName: "console-config") pod "768b9396-fa1d-46ba-be13-1230f4d971fb" (UID: "768b9396-fa1d-46ba-be13-1230f4d971fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:20:58.516985 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.516953 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "768b9396-fa1d-46ba-be13-1230f4d971fb" (UID: "768b9396-fa1d-46ba-be13-1230f4d971fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:20:58.518442 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.518412 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "768b9396-fa1d-46ba-be13-1230f4d971fb" (UID: "768b9396-fa1d-46ba-be13-1230f4d971fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:20:58.518634 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.518609 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "768b9396-fa1d-46ba-be13-1230f4d971fb" (UID: "768b9396-fa1d-46ba-be13-1230f4d971fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:20:58.518718 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.518627 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768b9396-fa1d-46ba-be13-1230f4d971fb-kube-api-access-8gvck" (OuterVolumeSpecName: "kube-api-access-8gvck") pod "768b9396-fa1d-46ba-be13-1230f4d971fb" (UID: "768b9396-fa1d-46ba-be13-1230f4d971fb"). InnerVolumeSpecName "kube-api-access-8gvck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:20:58.616870 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.616848 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-console-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:20:58.616870 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.616867 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-serving-cert\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:20:58.616995 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.616879 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768b9396-fa1d-46ba-be13-1230f4d971fb-service-ca\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:20:58.616995 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.616889 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768b9396-fa1d-46ba-be13-1230f4d971fb-console-oauth-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:20:58.616995 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:58.616897 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gvck\" (UniqueName: \"kubernetes.io/projected/768b9396-fa1d-46ba-be13-1230f4d971fb-kube-api-access-8gvck\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:20:59.179028 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.178991 2579 generic.go:356] "Generic (PLEG): container finished" podID="768b9396-fa1d-46ba-be13-1230f4d971fb" containerID="a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f" exitCode=0 Jul 06 15:20:59.179449 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.179046 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc8cdf4b-4rzrb" Jul 06 15:20:59.179449 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.179070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc8cdf4b-4rzrb" event={"ID":"768b9396-fa1d-46ba-be13-1230f4d971fb","Type":"ContainerDied","Data":"a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f"} Jul 06 15:20:59.179449 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.179115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc8cdf4b-4rzrb" event={"ID":"768b9396-fa1d-46ba-be13-1230f4d971fb","Type":"ContainerDied","Data":"ee35fa6d324affef97f22a812ac1948414e3eb1a8325e9e0a7c0c258acc9a2bc"} Jul 06 15:20:59.179449 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.179133 2579 scope.go:117] "RemoveContainer" containerID="a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f" Jul 06 15:20:59.187623 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.187608 2579 scope.go:117] "RemoveContainer" containerID="a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f" Jul 06 15:20:59.187887 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:20:59.187867 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f\": container with ID starting with a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f not found: ID does not exist" containerID="a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f" Jul 06 15:20:59.187951 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.187894 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f"} err="failed to get container status \"a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f\": rpc error: code = NotFound desc = could not find container \"a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f\": container with ID starting with a04e7858acf59e20baf2548f21429d095d9431c283662c6182ca273b6eab3b6f not found: ID does not exist" Jul 06 15:20:59.209341 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.209310 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66cc8cdf4b-4rzrb"] Jul 06 15:20:59.216778 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:20:59.216757 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66cc8cdf4b-4rzrb"] Jul 06 15:21:00.165792 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:00.165760 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768b9396-fa1d-46ba-be13-1230f4d971fb" path="/var/lib/kubelet/pods/768b9396-fa1d-46ba-be13-1230f4d971fb/volumes" Jul 06 15:21:05.400925 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.400882 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58d99f74c8-4msrq"] Jul 06 15:21:05.401310 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.401241 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768b9396-fa1d-46ba-be13-1230f4d971fb" containerName="console" Jul 06 15:21:05.401310 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.401253 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="768b9396-fa1d-46ba-be13-1230f4d971fb" containerName="console" Jul 06 15:21:05.401385 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.401321 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="768b9396-fa1d-46ba-be13-1230f4d971fb" containerName="console" Jul 06 15:21:05.412853 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.412813 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.427503 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.427482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d99f74c8-4msrq"] Jul 06 15:21:05.465327 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-service-ca\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.465470 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-trusted-ca-bundle\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.465470 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465364 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-oauth-serving-cert\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.465470 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-oauth-config\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.465594 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-console-config\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.465594 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfwrb\" (UniqueName: \"kubernetes.io/projected/3b63b907-44cf-48c1-9c46-1bf68468db69-kube-api-access-jfwrb\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.465594 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.465554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-serving-cert\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566567 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfwrb\" (UniqueName: \"kubernetes.io/projected/3b63b907-44cf-48c1-9c46-1bf68468db69-kube-api-access-jfwrb\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566672 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-serving-cert\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566672 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-service-ca\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566672 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-trusted-ca-bundle\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566791 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-oauth-serving-cert\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566791 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-oauth-config\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.566791 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.566731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-console-config\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.567475 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.567453 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-service-ca\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.567563 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.567479 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-oauth-serving-cert\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.567637 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.567616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-console-config\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.567673 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.567616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-trusted-ca-bundle\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.569108 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.569087 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-oauth-config\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.569187 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.569133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-serving-cert\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.575685 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.575665 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfwrb\" (UniqueName: \"kubernetes.io/projected/3b63b907-44cf-48c1-9c46-1bf68468db69-kube-api-access-jfwrb\") pod \"console-58d99f74c8-4msrq\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.722171 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.722105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:05.875563 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:05.875534 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d99f74c8-4msrq"] Jul 06 15:21:05.877224 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:21:05.877193 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b63b907_44cf_48c1_9c46_1bf68468db69.slice/crio-9186d378f6e4cd47953c708d8b5a920fd8a7f4b42071511e6cc86d2ed039a30a WatchSource:0}: Error finding container 9186d378f6e4cd47953c708d8b5a920fd8a7f4b42071511e6cc86d2ed039a30a: Status 404 returned error can't find the container with id 9186d378f6e4cd47953c708d8b5a920fd8a7f4b42071511e6cc86d2ed039a30a Jul 06 15:21:06.207219 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:06.207186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d99f74c8-4msrq" event={"ID":"3b63b907-44cf-48c1-9c46-1bf68468db69","Type":"ContainerStarted","Data":"c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00"} Jul 06 15:21:06.207372 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:06.207241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d99f74c8-4msrq" event={"ID":"3b63b907-44cf-48c1-9c46-1bf68468db69","Type":"ContainerStarted","Data":"9186d378f6e4cd47953c708d8b5a920fd8a7f4b42071511e6cc86d2ed039a30a"} Jul 06 15:21:06.244463 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:06.244415 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58d99f74c8-4msrq" podStartSLOduration=1.244399713 podStartE2EDuration="1.244399713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:21:06.243543978 +0000 UTC m=+232.553916088" watchObservedRunningTime="2026-07-06 15:21:06.244399713 +0000 UTC m=+232.554771823" Jul 06 15:21:08.062090 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062054 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:21:08.062473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062373 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="alertmanager" containerID="cri-o://fc359bf63ff24f42eb9890518171e778b9031a9bc280dd6c858d6db7512db1a2" gracePeriod=120 Jul 06 15:21:08.062473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062412 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-metric" containerID="cri-o://62a68c9326f1ed243689976c11e37d0e2fbe599f4e7423e21639f7731ff60df2" gracePeriod=120 Jul 06 15:21:08.062473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062453 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="prom-label-proxy" containerID="cri-o://28f411ae54bb01d3a3354b06e34253a657a564d4e783126175e3b0a3bedbe5e5" gracePeriod=120 Jul 06 15:21:08.062473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062466 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-web" containerID="cri-o://6f922f3d333b5a8497d76d8c535fdd6037505192781253f0083b22eb4f63e735" gracePeriod=120 Jul 06 15:21:08.062696 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062505 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="config-reloader" containerID="cri-o://01788270703ab595c500f232abcdab548116a903bab663b8e5052aa70bff97cc" gracePeriod=120 Jul 06 15:21:08.062696 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.062472 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy" containerID="cri-o://e00c3ac19d64663dce115aedd46fa1826d1d610f2ed193f14b03d92543919d16" gracePeriod=120 Jul 06 15:21:08.218611 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218583 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="28f411ae54bb01d3a3354b06e34253a657a564d4e783126175e3b0a3bedbe5e5" exitCode=0 Jul 06 15:21:08.218611 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218606 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="e00c3ac19d64663dce115aedd46fa1826d1d610f2ed193f14b03d92543919d16" exitCode=0 Jul 06 15:21:08.218611 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218613 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="01788270703ab595c500f232abcdab548116a903bab663b8e5052aa70bff97cc" exitCode=0 Jul 06 15:21:08.218778 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218618 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="fc359bf63ff24f42eb9890518171e778b9031a9bc280dd6c858d6db7512db1a2" exitCode=0 Jul 06 15:21:08.218778 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218641 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"28f411ae54bb01d3a3354b06e34253a657a564d4e783126175e3b0a3bedbe5e5"} Jul 06 15:21:08.218778 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"e00c3ac19d64663dce115aedd46fa1826d1d610f2ed193f14b03d92543919d16"} Jul 06 15:21:08.218778 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218721 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"01788270703ab595c500f232abcdab548116a903bab663b8e5052aa70bff97cc"} Jul 06 15:21:08.218778 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:08.218746 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"fc359bf63ff24f42eb9890518171e778b9031a9bc280dd6c858d6db7512db1a2"} Jul 06 15:21:09.226134 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.226108 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="62a68c9326f1ed243689976c11e37d0e2fbe599f4e7423e21639f7731ff60df2" exitCode=0 Jul 06 15:21:09.226134 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.226133 2579 generic.go:356] "Generic (PLEG): container finished" podID="b284344c-6d96-4852-89bc-e84ae42d603e" containerID="6f922f3d333b5a8497d76d8c535fdd6037505192781253f0083b22eb4f63e735" exitCode=0 Jul 06 15:21:09.226435 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.226159 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"62a68c9326f1ed243689976c11e37d0e2fbe599f4e7423e21639f7731ff60df2"} Jul 06 15:21:09.226435 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.226215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"6f922f3d333b5a8497d76d8c535fdd6037505192781253f0083b22eb4f63e735"} Jul 06 15:21:09.796403 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.796382 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:09.907143 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907048 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-metrics-client-ca\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907169 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-web-config\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907205 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-cluster-tls-config\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907250 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-tls-assets\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907278 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59ffp\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-kube-api-access-59ffp\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907301 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907341 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-main-db\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907378 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907425 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907462 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-web\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907500 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-config-out\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907528 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-trusted-ca-bundle\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907584 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.907683 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907614 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-config-volume\") pod \"b284344c-6d96-4852-89bc-e84ae42d603e\" (UID: \"b284344c-6d96-4852-89bc-e84ae42d603e\") " Jul 06 15:21:09.908069 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907784 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:21:09.908069 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907955 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-metrics-client-ca\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:09.908069 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.907973 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-main-db\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:09.909760 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.909728 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:21:09.910339 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.910301 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:09.910577 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.910553 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-config-volume" (OuterVolumeSpecName: "config-volume") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:09.910721 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.910694 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-kube-api-access-59ffp" (OuterVolumeSpecName: "kube-api-access-59ffp") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "kube-api-access-59ffp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:21:09.910939 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.910919 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:21:09.911093 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.911071 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:09.911420 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.911392 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:09.911755 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.911733 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:09.911903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.911880 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-config-out" (OuterVolumeSpecName: "config-out") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:21:09.915570 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.915548 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:09.922238 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:09.922220 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-web-config" (OuterVolumeSpecName: "web-config") pod "b284344c-6d96-4852-89bc-e84ae42d603e" (UID: "b284344c-6d96-4852-89bc-e84ae42d603e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:10.009010 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.008986 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009010 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009008 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009019 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b284344c-6d96-4852-89bc-e84ae42d603e-config-out\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009028 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b284344c-6d96-4852-89bc-e84ae42d603e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009036 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009046 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-config-volume\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009055 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-web-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009062 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-cluster-tls-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009075 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-tls-assets\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009088 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59ffp\" (UniqueName: \"kubernetes.io/projected/b284344c-6d96-4852-89bc-e84ae42d603e-kube-api-access-59ffp\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.009140 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.009096 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b284344c-6d96-4852-89bc-e84ae42d603e-secret-alertmanager-main-tls\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:10.233217 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.233196 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.233574 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.233195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b284344c-6d96-4852-89bc-e84ae42d603e","Type":"ContainerDied","Data":"d7d396a3918f3df8081c90b3f697a4d8d60af3a88045bc9d9f55b1d95ba9641e"} Jul 06 15:21:10.233574 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.233344 2579 scope.go:117] "RemoveContainer" containerID="28f411ae54bb01d3a3354b06e34253a657a564d4e783126175e3b0a3bedbe5e5" Jul 06 15:21:10.240887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.240872 2579 scope.go:117] "RemoveContainer" containerID="62a68c9326f1ed243689976c11e37d0e2fbe599f4e7423e21639f7731ff60df2" Jul 06 15:21:10.252821 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.252798 2579 scope.go:117] "RemoveContainer" containerID="e00c3ac19d64663dce115aedd46fa1826d1d610f2ed193f14b03d92543919d16" Jul 06 15:21:10.259473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.259459 2579 scope.go:117] "RemoveContainer" containerID="6f922f3d333b5a8497d76d8c535fdd6037505192781253f0083b22eb4f63e735" Jul 06 15:21:10.265860 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.265823 2579 scope.go:117] "RemoveContainer" containerID="01788270703ab595c500f232abcdab548116a903bab663b8e5052aa70bff97cc" Jul 06 15:21:10.268014 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.267990 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:21:10.273309 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.273293 2579 scope.go:117] "RemoveContainer" containerID="fc359bf63ff24f42eb9890518171e778b9031a9bc280dd6c858d6db7512db1a2" Jul 06 15:21:10.275739 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.275715 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:21:10.280458 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.280438 2579 scope.go:117] "RemoveContainer" containerID="92eb8e97ae83238d15ac2ef7fb4a604af810ec318fb1d008ec713a3102e35e72" Jul 06 15:21:10.321535 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321510 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:21:10.321856 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321843 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="init-config-reloader" Jul 06 15:21:10.321903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321858 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="init-config-reloader" Jul 06 15:21:10.321903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321872 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-web" Jul 06 15:21:10.321903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321877 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-web" Jul 06 15:21:10.321903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321884 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-metric" Jul 06 15:21:10.321903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321889 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-metric" Jul 06 15:21:10.321903 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321902 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="prom-label-proxy" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321907 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="prom-label-proxy" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321913 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="alertmanager" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321918 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="alertmanager" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321927 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="config-reloader" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321932 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="config-reloader" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321940 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321945 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321988 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="config-reloader" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.321997 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="alertmanager" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.322003 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.322010 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-metric" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.322016 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="prom-label-proxy" Jul 06 15:21:10.322076 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.322021 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" containerName="kube-rbac-proxy-web" Jul 06 15:21:10.325916 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.325900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.332394 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332582 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332591 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332651 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8rss4\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332591 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332698 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 15:21:10.332797 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.332584 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 15:21:10.340249 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.340230 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 15:21:10.349119 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.349098 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:21:10.412401 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412520 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a933678f-f5a6-49ae-9a88-e08038515792-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412520 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a933678f-f5a6-49ae-9a88-e08038515792-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412520 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412623 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-web-config\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412623 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412605 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a933678f-f5a6-49ae-9a88-e08038515792-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412700 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbrxl\" (UniqueName: \"kubernetes.io/projected/a933678f-f5a6-49ae-9a88-e08038515792-kube-api-access-hbrxl\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412700 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412700 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a933678f-f5a6-49ae-9a88-e08038515792-config-out\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412700 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a933678f-f5a6-49ae-9a88-e08038515792-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412867 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-config-volume\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412867 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.412867 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.412761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513419 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a933678f-f5a6-49ae-9a88-e08038515792-config-out\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513419 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a933678f-f5a6-49ae-9a88-e08038515792-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513419 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-config-volume\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513419 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a933678f-f5a6-49ae-9a88-e08038515792-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a933678f-f5a6-49ae-9a88-e08038515792-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-web-config\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a933678f-f5a6-49ae-9a88-e08038515792-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.513695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrxl\" (UniqueName: \"kubernetes.io/projected/a933678f-f5a6-49ae-9a88-e08038515792-kube-api-access-hbrxl\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.514110 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.514110 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.513799 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a933678f-f5a6-49ae-9a88-e08038515792-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.516362 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.516329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.516492 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.516472 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-config-volume\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.516558 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.516544 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a933678f-f5a6-49ae-9a88-e08038515792-config-out\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.516618 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.516569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.516943 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.516921 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a933678f-f5a6-49ae-9a88-e08038515792-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.517238 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.517212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.517306 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.517266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a933678f-f5a6-49ae-9a88-e08038515792-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.517367 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.517321 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.517473 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.517456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-web-config\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.517740 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.517717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a933678f-f5a6-49ae-9a88-e08038515792-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.518582 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.518562 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a933678f-f5a6-49ae-9a88-e08038515792-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.530759 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.530737 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbrxl\" (UniqueName: \"kubernetes.io/projected/a933678f-f5a6-49ae-9a88-e08038515792-kube-api-access-hbrxl\") pod \"alertmanager-main-0\" (UID: \"a933678f-f5a6-49ae-9a88-e08038515792\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.634495 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.634474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 15:21:10.781995 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:10.781971 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 15:21:10.783468 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:21:10.783441 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda933678f_f5a6_49ae_9a88_e08038515792.slice/crio-b0ff495d680441e09cf1d527825128abcddd4a054776b39155c91f2efdca5280 WatchSource:0}: Error finding container b0ff495d680441e09cf1d527825128abcddd4a054776b39155c91f2efdca5280: Status 404 returned error can't find the container with id b0ff495d680441e09cf1d527825128abcddd4a054776b39155c91f2efdca5280 Jul 06 15:21:11.239123 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:11.239040 2579 generic.go:356] "Generic (PLEG): container finished" podID="a933678f-f5a6-49ae-9a88-e08038515792" containerID="56e2e24679a14a844f1866a70eb4e43c628424b7066ecee4dd70aa4defcb2c3b" exitCode=0 Jul 06 15:21:11.239461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:11.239124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerDied","Data":"56e2e24679a14a844f1866a70eb4e43c628424b7066ecee4dd70aa4defcb2c3b"} Jul 06 15:21:11.239461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:11.239194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"b0ff495d680441e09cf1d527825128abcddd4a054776b39155c91f2efdca5280"} Jul 06 15:21:12.165653 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.165620 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b284344c-6d96-4852-89bc-e84ae42d603e" path="/var/lib/kubelet/pods/b284344c-6d96-4852-89bc-e84ae42d603e/volumes" Jul 06 15:21:12.249499 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.249456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"5226c7d081036996936667395d333550ee0acde360f461b68c2f0acd7e6fdd7f"} Jul 06 15:21:12.249982 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.249529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"47316059446ec40846fa3d7f66f71daa83984de8ef4ef99e0ec75b85a22bee17"} Jul 06 15:21:12.249982 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.249555 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"2b95211f0acb7092241d093973ca5a991bf0faeed884731e1cc5079bde87779b"} Jul 06 15:21:12.249982 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.249581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"9e6f0037ebf0586d7f1a12a1c9f894568f56d176d2735a49093f425b69d2942e"} Jul 06 15:21:12.249982 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.249616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"d1374937be13d679922912d9a7119c315619f54b8ac040b453370d769c3874a1"} Jul 06 15:21:12.249982 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:12.249643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a933678f-f5a6-49ae-9a88-e08038515792","Type":"ContainerStarted","Data":"021abaa4571dff7ebc32fa74d779f243c5eea47400eb2185e39652f15f032ed1"} Jul 06 15:21:15.722694 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:15.722654 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:15.723144 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:15.722713 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:15.727678 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:15.727652 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:15.755001 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:15.754955 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.735597224 podStartE2EDuration="5.754940453s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.343229ms" isStatefulPod=false podCreationTimestamp="2026-07-06 15:21:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:21:12.315686625 +0000 UTC m=+238.626058737" watchObservedRunningTime="2026-07-06 15:21:15.754940453 +0000 UTC m=+242.065312619" Jul 06 15:21:16.274954 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:16.274925 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:21:16.340534 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:16.340490 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd6c9b48b-mf9zx"] Jul 06 15:21:26.052900 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:26.052864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:21:26.055142 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:26.055121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f670ea7-0a33-4e6f-ba95-2669c07c4e4a-metrics-certs\") pod \"network-metrics-daemon-xlgj5\" (UID: \"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a\") " pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:21:26.265127 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:26.265096 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gh99x\"" Jul 06 15:21:26.271899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:26.271870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xlgj5" Jul 06 15:21:26.400771 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:26.400668 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xlgj5"] Jul 06 15:21:26.403593 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:21:26.403570 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f670ea7_0a33_4e6f_ba95_2669c07c4e4a.slice/crio-c5a4e07c8a29fb52a1c8f240f9203124271eedbb89cfabdc0ce1229daeab94c6 WatchSource:0}: Error finding container c5a4e07c8a29fb52a1c8f240f9203124271eedbb89cfabdc0ce1229daeab94c6: Status 404 returned error can't find the container with id c5a4e07c8a29fb52a1c8f240f9203124271eedbb89cfabdc0ce1229daeab94c6 Jul 06 15:21:27.316042 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:27.316004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xlgj5" event={"ID":"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a","Type":"ContainerStarted","Data":"c5a4e07c8a29fb52a1c8f240f9203124271eedbb89cfabdc0ce1229daeab94c6"} Jul 06 15:21:28.321718 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:28.321685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xlgj5" event={"ID":"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a","Type":"ContainerStarted","Data":"7bf9f8b9cc866a967e6d93c62e2db1c12d864e4a88d59ad28cc3c1f50db51994"} Jul 06 15:21:28.322118 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:28.321734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xlgj5" event={"ID":"8f670ea7-0a33-4e6f-ba95-2669c07c4e4a","Type":"ContainerStarted","Data":"8178d527d6cf1805a3bcb071a6b48257fd72252aeeb7c5439f60b847a3da496d"} Jul 06 15:21:41.360290 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.360202 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cd6c9b48b-mf9zx" podUID="fcf49c4c-9871-419c-a366-6abe6109fd43" containerName="console" containerID="cri-o://cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d" gracePeriod=15 Jul 06 15:21:41.593131 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.593108 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:21:41.619294 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.619219 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xlgj5" podStartSLOduration=266.587270663 podStartE2EDuration="4m27.619203727s" totalImagesPullingTime="1.031933064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:21:28.35177376 +0000 UTC m=+254.662145870" watchObservedRunningTime="2026-07-06 15:21:41.619203727 +0000 UTC m=+267.929575837" Jul 06 15:21:41.685143 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-oauth-serving-cert\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685149 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-serving-cert\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685167 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-trusted-ca-bundle\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685239 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwgvm\" (UniqueName: \"kubernetes.io/projected/fcf49c4c-9871-419c-a366-6abe6109fd43-kube-api-access-zwgvm\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685268 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-service-ca\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685466 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685331 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-console-config\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685466 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685363 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-oauth-config\") pod \"fcf49c4c-9871-419c-a366-6abe6109fd43\" (UID: \"fcf49c4c-9871-419c-a366-6abe6109fd43\") " Jul 06 15:21:41.685594 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685525 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:21:41.685736 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685656 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-oauth-serving-cert\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:41.685736 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685690 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:21:41.685736 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685714 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-service-ca" (OuterVolumeSpecName: "service-ca") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:21:41.685928 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.685756 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-console-config" (OuterVolumeSpecName: "console-config") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:21:41.687304 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.687276 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:41.687500 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.687484 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:21:41.687661 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.687640 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf49c4c-9871-419c-a366-6abe6109fd43-kube-api-access-zwgvm" (OuterVolumeSpecName: "kube-api-access-zwgvm") pod "fcf49c4c-9871-419c-a366-6abe6109fd43" (UID: "fcf49c4c-9871-419c-a366-6abe6109fd43"). InnerVolumeSpecName "kube-api-access-zwgvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:21:41.786162 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.786132 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwgvm\" (UniqueName: \"kubernetes.io/projected/fcf49c4c-9871-419c-a366-6abe6109fd43-kube-api-access-zwgvm\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:41.786162 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.786156 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-service-ca\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:41.786162 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.786166 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-console-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:41.786363 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.786173 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-oauth-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:41.786363 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.786182 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcf49c4c-9871-419c-a366-6abe6109fd43-console-serving-cert\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:41.786363 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:41.786191 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcf49c4c-9871-419c-a366-6abe6109fd43-trusted-ca-bundle\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:21:42.380447 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.380408 2579 generic.go:356] "Generic (PLEG): container finished" podID="fcf49c4c-9871-419c-a366-6abe6109fd43" containerID="cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d" exitCode=0 Jul 06 15:21:42.380873 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.380461 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd6c9b48b-mf9zx" Jul 06 15:21:42.380873 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.380493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd6c9b48b-mf9zx" event={"ID":"fcf49c4c-9871-419c-a366-6abe6109fd43","Type":"ContainerDied","Data":"cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d"} Jul 06 15:21:42.380873 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.380544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd6c9b48b-mf9zx" event={"ID":"fcf49c4c-9871-419c-a366-6abe6109fd43","Type":"ContainerDied","Data":"f4ce5411e5e0b0a7008e75e73ea887a86e75c7bcd9b006e6ed891c7d85979d69"} Jul 06 15:21:42.380873 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.380574 2579 scope.go:117] "RemoveContainer" containerID="cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d" Jul 06 15:21:42.388860 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.388825 2579 scope.go:117] "RemoveContainer" containerID="cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d" Jul 06 15:21:42.389133 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:21:42.389114 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d\": container with ID starting with cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d not found: ID does not exist" containerID="cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d" Jul 06 15:21:42.389193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.389145 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d"} err="failed to get container status \"cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d\": rpc error: code = NotFound desc = could not find container \"cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d\": container with ID starting with cc840d3f7de8a48983e78ec13cffc0f9344ff45de4e6f153cbeeeb68d04f7b1d not found: ID does not exist" Jul 06 15:21:42.404074 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.404052 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd6c9b48b-mf9zx"] Jul 06 15:21:42.413273 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:42.413248 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cd6c9b48b-mf9zx"] Jul 06 15:21:44.165884 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:21:44.165851 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf49c4c-9871-419c-a366-6abe6109fd43" path="/var/lib/kubelet/pods/fcf49c4c-9871-419c-a366-6abe6109fd43/volumes" Jul 06 15:22:12.998600 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:12.998564 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm"] Jul 06 15:22:12.999097 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:12.998941 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf49c4c-9871-419c-a366-6abe6109fd43" containerName="console" Jul 06 15:22:12.999097 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:12.998953 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf49c4c-9871-419c-a366-6abe6109fd43" containerName="console" Jul 06 15:22:12.999097 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:12.999021 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf49c4c-9871-419c-a366-6abe6109fd43" containerName="console" Jul 06 15:22:13.001245 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.001230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.004143 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.004127 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:22:13.005335 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.005317 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:22:13.005439 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.005342 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7rqd\"" Jul 06 15:22:13.016647 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.016626 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm"] Jul 06 15:22:13.101003 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.100971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.101164 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.101027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h2bl\" (UniqueName: \"kubernetes.io/projected/62ff69f0-54fe-4669-8bc4-639d61a433cf-kube-api-access-5h2bl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.101164 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.101083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.202398 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.202365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.202544 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.202421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h2bl\" (UniqueName: \"kubernetes.io/projected/62ff69f0-54fe-4669-8bc4-639d61a433cf-kube-api-access-5h2bl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.202544 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.202449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.202735 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.202718 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.202789 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.202771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.215589 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.215558 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h2bl\" (UniqueName: \"kubernetes.io/projected/62ff69f0-54fe-4669-8bc4-639d61a433cf-kube-api-access-5h2bl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.310168 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.310100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:13.444553 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.444482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm"] Jul 06 15:22:13.447296 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:22:13.447270 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ff69f0_54fe_4669_8bc4_639d61a433cf.slice/crio-3ea3d08f1c0649149c9d4e7ead1c52a3722050e90819966bb35c8a260eb31d2c WatchSource:0}: Error finding container 3ea3d08f1c0649149c9d4e7ead1c52a3722050e90819966bb35c8a260eb31d2c: Status 404 returned error can't find the container with id 3ea3d08f1c0649149c9d4e7ead1c52a3722050e90819966bb35c8a260eb31d2c Jul 06 15:22:13.507418 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:13.507383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" event={"ID":"62ff69f0-54fe-4669-8bc4-639d61a433cf","Type":"ContainerStarted","Data":"3ea3d08f1c0649149c9d4e7ead1c52a3722050e90819966bb35c8a260eb31d2c"} Jul 06 15:22:14.047433 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:14.047398 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:22:14.054765 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:14.054724 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:22:14.063792 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:14.063769 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 15:22:19.535629 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:19.535594 2579 generic.go:356] "Generic (PLEG): container finished" podID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerID="b1916822e15ce984528e51dd70ee68b0276f8dc7d3a3be129b79ae5f19cf0a7f" exitCode=0 Jul 06 15:22:19.536051 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:19.535644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" event={"ID":"62ff69f0-54fe-4669-8bc4-639d61a433cf","Type":"ContainerDied","Data":"b1916822e15ce984528e51dd70ee68b0276f8dc7d3a3be129b79ae5f19cf0a7f"} Jul 06 15:22:19.536708 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:19.536691 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:22:22.551551 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:22.551517 2579 generic.go:356] "Generic (PLEG): container finished" podID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerID="06fd6a078ead8550a45d80be368cbf415fb125f8c2ae7f02fb0701f9488f8f5a" exitCode=0 Jul 06 15:22:22.552029 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:22.551597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" event={"ID":"62ff69f0-54fe-4669-8bc4-639d61a433cf","Type":"ContainerDied","Data":"06fd6a078ead8550a45d80be368cbf415fb125f8c2ae7f02fb0701f9488f8f5a"} Jul 06 15:22:30.593758 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:30.593722 2579 generic.go:356] "Generic (PLEG): container finished" podID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerID="b33433def767d97b6a79c2ad798df55463d995352580ed67de3f2995ae67f347" exitCode=0 Jul 06 15:22:30.594170 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:30.593789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" event={"ID":"62ff69f0-54fe-4669-8bc4-639d61a433cf","Type":"ContainerDied","Data":"b33433def767d97b6a79c2ad798df55463d995352580ed67de3f2995ae67f347"} Jul 06 15:22:31.722154 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.722132 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:31.866766 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.866694 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-bundle\") pod \"62ff69f0-54fe-4669-8bc4-639d61a433cf\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " Jul 06 15:22:31.866766 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.866748 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h2bl\" (UniqueName: \"kubernetes.io/projected/62ff69f0-54fe-4669-8bc4-639d61a433cf-kube-api-access-5h2bl\") pod \"62ff69f0-54fe-4669-8bc4-639d61a433cf\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " Jul 06 15:22:31.866962 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.866790 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-util\") pod \"62ff69f0-54fe-4669-8bc4-639d61a433cf\" (UID: \"62ff69f0-54fe-4669-8bc4-639d61a433cf\") " Jul 06 15:22:31.867373 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.867346 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-bundle" (OuterVolumeSpecName: "bundle") pod "62ff69f0-54fe-4669-8bc4-639d61a433cf" (UID: "62ff69f0-54fe-4669-8bc4-639d61a433cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:22:31.868877 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.868855 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ff69f0-54fe-4669-8bc4-639d61a433cf-kube-api-access-5h2bl" (OuterVolumeSpecName: "kube-api-access-5h2bl") pod "62ff69f0-54fe-4669-8bc4-639d61a433cf" (UID: "62ff69f0-54fe-4669-8bc4-639d61a433cf"). InnerVolumeSpecName "kube-api-access-5h2bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:22:31.871641 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.871619 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-util" (OuterVolumeSpecName: "util") pod "62ff69f0-54fe-4669-8bc4-639d61a433cf" (UID: "62ff69f0-54fe-4669-8bc4-639d61a433cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:22:31.968041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.968006 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-util\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:22:31.968041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.968037 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62ff69f0-54fe-4669-8bc4-639d61a433cf-bundle\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:22:31.968041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:31.968047 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h2bl\" (UniqueName: \"kubernetes.io/projected/62ff69f0-54fe-4669-8bc4-639d61a433cf-kube-api-access-5h2bl\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:22:32.604072 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:32.604049 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" Jul 06 15:22:32.604072 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:32.604062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540htvwm" event={"ID":"62ff69f0-54fe-4669-8bc4-639d61a433cf","Type":"ContainerDied","Data":"3ea3d08f1c0649149c9d4e7ead1c52a3722050e90819966bb35c8a260eb31d2c"} Jul 06 15:22:32.604277 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:32.604110 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ea3d08f1c0649149c9d4e7ead1c52a3722050e90819966bb35c8a260eb31d2c" Jul 06 15:22:36.169666 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.169639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6"] Jul 06 15:22:36.170062 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.169985 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="extract" Jul 06 15:22:36.170062 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.169999 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="extract" Jul 06 15:22:36.170062 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.170013 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="pull" Jul 06 15:22:36.170062 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.170020 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="pull" Jul 06 15:22:36.170062 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.170032 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="util" Jul 06 15:22:36.170062 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.170037 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="util" Jul 06 15:22:36.170242 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.170086 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ff69f0-54fe-4669-8bc4-639d61a433cf" containerName="extract" Jul 06 15:22:36.180466 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.180448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.183867 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.183828 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tbsqr\"" Jul 06 15:22:36.184224 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.184202 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:22:36.184316 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.184203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 15:22:36.194082 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.194058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6"] Jul 06 15:22:36.305866 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.305828 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfd00dcf-3f60-435b-b4a1-b25f836a7ffd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kw4n6\" (UID: \"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.306023 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.305900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjm4j\" (UniqueName: \"kubernetes.io/projected/dfd00dcf-3f60-435b-b4a1-b25f836a7ffd-kube-api-access-jjm4j\") pod \"cert-manager-operator-controller-manager-55c444bf86-kw4n6\" (UID: \"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.407170 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.407141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfd00dcf-3f60-435b-b4a1-b25f836a7ffd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kw4n6\" (UID: \"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.407318 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.407185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjm4j\" (UniqueName: \"kubernetes.io/projected/dfd00dcf-3f60-435b-b4a1-b25f836a7ffd-kube-api-access-jjm4j\") pod \"cert-manager-operator-controller-manager-55c444bf86-kw4n6\" (UID: \"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.407492 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.407474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfd00dcf-3f60-435b-b4a1-b25f836a7ffd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kw4n6\" (UID: \"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.422000 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.421949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjm4j\" (UniqueName: \"kubernetes.io/projected/dfd00dcf-3f60-435b-b4a1-b25f836a7ffd-kube-api-access-jjm4j\") pod \"cert-manager-operator-controller-manager-55c444bf86-kw4n6\" (UID: \"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.489799 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.489778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" Jul 06 15:22:36.659602 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:36.659571 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6"] Jul 06 15:22:36.666792 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:22:36.666746 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd00dcf_3f60_435b_b4a1_b25f836a7ffd.slice/crio-2441714b684b3f9e1015505308f8cb2bc98ad11cb244226743f2431225d4fd13 WatchSource:0}: Error finding container 2441714b684b3f9e1015505308f8cb2bc98ad11cb244226743f2431225d4fd13: Status 404 returned error can't find the container with id 2441714b684b3f9e1015505308f8cb2bc98ad11cb244226743f2431225d4fd13 Jul 06 15:22:37.627704 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:37.627668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" event={"ID":"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd","Type":"ContainerStarted","Data":"2441714b684b3f9e1015505308f8cb2bc98ad11cb244226743f2431225d4fd13"} Jul 06 15:22:39.640019 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:39.639973 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" event={"ID":"dfd00dcf-3f60-435b-b4a1-b25f836a7ffd","Type":"ContainerStarted","Data":"5f844b9bc7174a7148b4e8bdc26b06a8e76fdb7080e16b640a34e6755667d956"} Jul 06 15:22:39.670873 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:39.670797 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kw4n6" podStartSLOduration=1.575427068 podStartE2EDuration="3.670778259s" totalImagesPullingTime="2.095351191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:22:39.667681442 +0000 UTC m=+325.978053552" watchObservedRunningTime="2026-07-06 15:22:39.670778259 +0000 UTC m=+325.981150369" Jul 06 15:22:40.451133 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.451097 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9"] Jul 06 15:22:40.453703 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.453680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.456767 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.456738 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:22:40.456904 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.456745 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:22:40.457906 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.457889 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7rqd\"" Jul 06 15:22:40.470828 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.470807 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9"] Jul 06 15:22:40.543350 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.543319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxd6p\" (UniqueName: \"kubernetes.io/projected/7a28b2b0-6afe-4af3-800a-bfff501113a4-kube-api-access-pxd6p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.543516 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.543475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.543588 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.543541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.644175 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.644147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxd6p\" (UniqueName: \"kubernetes.io/projected/7a28b2b0-6afe-4af3-800a-bfff501113a4-kube-api-access-pxd6p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.644578 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.644221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.644578 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.644268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.644721 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.644698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.644772 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.644729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.674669 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.674643 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxd6p\" (UniqueName: \"kubernetes.io/projected/7a28b2b0-6afe-4af3-800a-bfff501113a4-kube-api-access-pxd6p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.763590 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.763565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:40.774124 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.774102 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ctdfz"] Jul 06 15:22:40.777238 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.777220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:40.781322 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.781298 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 15:22:40.781441 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.781365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wdz4l\"" Jul 06 15:22:40.781513 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.781486 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 15:22:40.804820 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.804764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ctdfz"] Jul 06 15:22:40.902216 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.902191 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9"] Jul 06 15:22:40.904020 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:22:40.903993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a28b2b0_6afe_4af3_800a_bfff501113a4.slice/crio-7ca898c83fe6eb4abe61779032add2a552c71281bef004235f876c0f6533f396 WatchSource:0}: Error finding container 7ca898c83fe6eb4abe61779032add2a552c71281bef004235f876c0f6533f396: Status 404 returned error can't find the container with id 7ca898c83fe6eb4abe61779032add2a552c71281bef004235f876c0f6533f396 Jul 06 15:22:40.946106 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.946086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmd42\" (UniqueName: \"kubernetes.io/projected/2bc056ba-306b-4478-9be5-d07cfa36d0cc-kube-api-access-dmd42\") pod \"cert-manager-webhook-6486ffd997-ctdfz\" (UID: \"2bc056ba-306b-4478-9be5-d07cfa36d0cc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:40.946191 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:40.946144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bc056ba-306b-4478-9be5-d07cfa36d0cc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ctdfz\" (UID: \"2bc056ba-306b-4478-9be5-d07cfa36d0cc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:41.047171 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.047119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bc056ba-306b-4478-9be5-d07cfa36d0cc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ctdfz\" (UID: \"2bc056ba-306b-4478-9be5-d07cfa36d0cc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:41.047266 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.047170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmd42\" (UniqueName: \"kubernetes.io/projected/2bc056ba-306b-4478-9be5-d07cfa36d0cc-kube-api-access-dmd42\") pod \"cert-manager-webhook-6486ffd997-ctdfz\" (UID: \"2bc056ba-306b-4478-9be5-d07cfa36d0cc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:41.058313 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.058293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bc056ba-306b-4478-9be5-d07cfa36d0cc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ctdfz\" (UID: \"2bc056ba-306b-4478-9be5-d07cfa36d0cc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:41.058434 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.058416 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmd42\" (UniqueName: \"kubernetes.io/projected/2bc056ba-306b-4478-9be5-d07cfa36d0cc-kube-api-access-dmd42\") pod \"cert-manager-webhook-6486ffd997-ctdfz\" (UID: \"2bc056ba-306b-4478-9be5-d07cfa36d0cc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:41.104967 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.104941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:41.237852 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.237805 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ctdfz"] Jul 06 15:22:41.241343 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:22:41.241316 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bc056ba_306b_4478_9be5_d07cfa36d0cc.slice/crio-324053d7d62c7c43f1e2bbde30e479c68e279d04568b8a41c4da99bd0b17417a WatchSource:0}: Error finding container 324053d7d62c7c43f1e2bbde30e479c68e279d04568b8a41c4da99bd0b17417a: Status 404 returned error can't find the container with id 324053d7d62c7c43f1e2bbde30e479c68e279d04568b8a41c4da99bd0b17417a Jul 06 15:22:41.651407 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.651372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" event={"ID":"2bc056ba-306b-4478-9be5-d07cfa36d0cc","Type":"ContainerStarted","Data":"324053d7d62c7c43f1e2bbde30e479c68e279d04568b8a41c4da99bd0b17417a"} Jul 06 15:22:41.652739 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.652708 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerID="654f2823ec53d4765a7982aa6798e44577f5c139e9efcc1ba88e0ad28881c5a5" exitCode=0 Jul 06 15:22:41.652883 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.652737 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" event={"ID":"7a28b2b0-6afe-4af3-800a-bfff501113a4","Type":"ContainerDied","Data":"654f2823ec53d4765a7982aa6798e44577f5c139e9efcc1ba88e0ad28881c5a5"} Jul 06 15:22:41.652883 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:41.652783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" event={"ID":"7a28b2b0-6afe-4af3-800a-bfff501113a4","Type":"ContainerStarted","Data":"7ca898c83fe6eb4abe61779032add2a552c71281bef004235f876c0f6533f396"} Jul 06 15:22:42.406226 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.406189 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl"] Jul 06 15:22:42.408589 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.408569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.411385 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.411356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l25vt\"" Jul 06 15:22:42.418652 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.418630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl"] Jul 06 15:22:42.559268 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.559230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnfbl\" (UniqueName: \"kubernetes.io/projected/c7587cd0-7c8f-4a1b-9eae-bcd5d257f391-kube-api-access-mnfbl\") pod \"cert-manager-cainjector-559cdd8c87-wwvtl\" (UID: \"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.559446 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.559313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7587cd0-7c8f-4a1b-9eae-bcd5d257f391-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wwvtl\" (UID: \"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.659942 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.659870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnfbl\" (UniqueName: \"kubernetes.io/projected/c7587cd0-7c8f-4a1b-9eae-bcd5d257f391-kube-api-access-mnfbl\") pod \"cert-manager-cainjector-559cdd8c87-wwvtl\" (UID: \"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.659942 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.659915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7587cd0-7c8f-4a1b-9eae-bcd5d257f391-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wwvtl\" (UID: \"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.670097 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.670066 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7587cd0-7c8f-4a1b-9eae-bcd5d257f391-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wwvtl\" (UID: \"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.670253 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.670234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnfbl\" (UniqueName: \"kubernetes.io/projected/c7587cd0-7c8f-4a1b-9eae-bcd5d257f391-kube-api-access-mnfbl\") pod \"cert-manager-cainjector-559cdd8c87-wwvtl\" (UID: \"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.719067 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.719032 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" Jul 06 15:22:42.869329 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:42.869269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl"] Jul 06 15:22:42.872646 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:22:42.872619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7587cd0_7c8f_4a1b_9eae_bcd5d257f391.slice/crio-2621c4fbdce9b48f89bbb9ed4cf1c429c7a8ffdd4c008dfb04f2a0c5a7cf3e65 WatchSource:0}: Error finding container 2621c4fbdce9b48f89bbb9ed4cf1c429c7a8ffdd4c008dfb04f2a0c5a7cf3e65: Status 404 returned error can't find the container with id 2621c4fbdce9b48f89bbb9ed4cf1c429c7a8ffdd4c008dfb04f2a0c5a7cf3e65 Jul 06 15:22:43.664816 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:43.664781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" event={"ID":"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391","Type":"ContainerStarted","Data":"2621c4fbdce9b48f89bbb9ed4cf1c429c7a8ffdd4c008dfb04f2a0c5a7cf3e65"} Jul 06 15:22:45.679088 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.679042 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" event={"ID":"2bc056ba-306b-4478-9be5-d07cfa36d0cc","Type":"ContainerStarted","Data":"99929d543d3d404cf32e8254499d31387850edae862fe3d33960d2ab3fc21e61"} Jul 06 15:22:45.679754 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.679105 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:45.681450 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.681420 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerID="d46e7d1c845905c48642e956792cd2001b09db06fde0fda61ecdaae6e6b7b4b3" exitCode=0 Jul 06 15:22:45.681561 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.681508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" event={"ID":"7a28b2b0-6afe-4af3-800a-bfff501113a4","Type":"ContainerDied","Data":"d46e7d1c845905c48642e956792cd2001b09db06fde0fda61ecdaae6e6b7b4b3"} Jul 06 15:22:45.683427 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.683400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" event={"ID":"c7587cd0-7c8f-4a1b-9eae-bcd5d257f391","Type":"ContainerStarted","Data":"32f3e245e38c088b026c06e30c2bb132ecd0b90ccfae631a4bc06de289389df7"} Jul 06 15:22:45.708232 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.708184 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" podStartSLOduration=1.505847947 podStartE2EDuration="5.708168505s" totalImagesPullingTime="4.202320558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:22:45.707286622 +0000 UTC m=+332.017658732" watchObservedRunningTime="2026-07-06 15:22:45.708168505 +0000 UTC m=+332.018540615" Jul 06 15:22:45.759193 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:45.759149 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wwvtl" podStartSLOduration=1.165907821 podStartE2EDuration="3.759132763s" totalImagesPullingTime="2.593224942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:22:45.757544613 +0000 UTC m=+332.067916725" watchObservedRunningTime="2026-07-06 15:22:45.759132763 +0000 UTC m=+332.069504872" Jul 06 15:22:46.689453 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:46.689422 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerID="f2081c13fa8950ec552a5781458df6dc952514891a7da5fce7e14ce8179a1ad1" exitCode=0 Jul 06 15:22:46.689862 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:46.689500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" event={"ID":"7a28b2b0-6afe-4af3-800a-bfff501113a4","Type":"ContainerDied","Data":"f2081c13fa8950ec552a5781458df6dc952514891a7da5fce7e14ce8179a1ad1"} Jul 06 15:22:47.811274 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.811251 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:47.903904 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.903875 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-util\") pod \"7a28b2b0-6afe-4af3-800a-bfff501113a4\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " Jul 06 15:22:47.904059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.903916 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-bundle\") pod \"7a28b2b0-6afe-4af3-800a-bfff501113a4\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " Jul 06 15:22:47.904059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.903956 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxd6p\" (UniqueName: \"kubernetes.io/projected/7a28b2b0-6afe-4af3-800a-bfff501113a4-kube-api-access-pxd6p\") pod \"7a28b2b0-6afe-4af3-800a-bfff501113a4\" (UID: \"7a28b2b0-6afe-4af3-800a-bfff501113a4\") " Jul 06 15:22:47.904317 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.904293 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-bundle" (OuterVolumeSpecName: "bundle") pod "7a28b2b0-6afe-4af3-800a-bfff501113a4" (UID: "7a28b2b0-6afe-4af3-800a-bfff501113a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:22:47.906051 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.906025 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a28b2b0-6afe-4af3-800a-bfff501113a4-kube-api-access-pxd6p" (OuterVolumeSpecName: "kube-api-access-pxd6p") pod "7a28b2b0-6afe-4af3-800a-bfff501113a4" (UID: "7a28b2b0-6afe-4af3-800a-bfff501113a4"). InnerVolumeSpecName "kube-api-access-pxd6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:22:47.909108 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:47.909086 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-util" (OuterVolumeSpecName: "util") pod "7a28b2b0-6afe-4af3-800a-bfff501113a4" (UID: "7a28b2b0-6afe-4af3-800a-bfff501113a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:22:48.004799 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:48.004777 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-util\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:22:48.004799 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:48.004798 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a28b2b0-6afe-4af3-800a-bfff501113a4-bundle\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:22:48.004957 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:48.004807 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxd6p\" (UniqueName: \"kubernetes.io/projected/7a28b2b0-6afe-4af3-800a-bfff501113a4-kube-api-access-pxd6p\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:22:48.699975 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:48.699949 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" Jul 06 15:22:48.700143 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:48.699979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs7rf9" event={"ID":"7a28b2b0-6afe-4af3-800a-bfff501113a4","Type":"ContainerDied","Data":"7ca898c83fe6eb4abe61779032add2a552c71281bef004235f876c0f6533f396"} Jul 06 15:22:48.700143 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:48.700022 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ca898c83fe6eb4abe61779032add2a552c71281bef004235f876c0f6533f396" Jul 06 15:22:51.692236 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:51.692208 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ctdfz" Jul 06 15:22:54.596104 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596067 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd"] Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596442 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="extract" Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596455 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="extract" Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596474 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="pull" Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596480 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="pull" Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596487 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="util" Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596492 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="util" Jul 06 15:22:54.596549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.596547 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a28b2b0-6afe-4af3-800a-bfff501113a4" containerName="extract" Jul 06 15:22:54.598358 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.598343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.601330 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.601315 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 15:22:54.602352 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.602337 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-979lk\"" Jul 06 15:22:54.602428 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.602410 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:22:54.610169 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.610146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd"] Jul 06 15:22:54.761515 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.761476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7v9\" (UniqueName: \"kubernetes.io/projected/5571d74e-7db6-4b2d-b969-459e1db8df4a-kube-api-access-qb7v9\") pod \"openshift-lws-operator-fd8ccff4c-wmcwd\" (UID: \"5571d74e-7db6-4b2d-b969-459e1db8df4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.761677 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.761603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5571d74e-7db6-4b2d-b969-459e1db8df4a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wmcwd\" (UID: \"5571d74e-7db6-4b2d-b969-459e1db8df4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.862547 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.862481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5571d74e-7db6-4b2d-b969-459e1db8df4a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wmcwd\" (UID: \"5571d74e-7db6-4b2d-b969-459e1db8df4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.862547 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.862520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7v9\" (UniqueName: \"kubernetes.io/projected/5571d74e-7db6-4b2d-b969-459e1db8df4a-kube-api-access-qb7v9\") pod \"openshift-lws-operator-fd8ccff4c-wmcwd\" (UID: \"5571d74e-7db6-4b2d-b969-459e1db8df4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.862825 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.862807 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5571d74e-7db6-4b2d-b969-459e1db8df4a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wmcwd\" (UID: \"5571d74e-7db6-4b2d-b969-459e1db8df4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.878380 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.878353 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7v9\" (UniqueName: \"kubernetes.io/projected/5571d74e-7db6-4b2d-b969-459e1db8df4a-kube-api-access-qb7v9\") pod \"openshift-lws-operator-fd8ccff4c-wmcwd\" (UID: \"5571d74e-7db6-4b2d-b969-459e1db8df4a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:54.907098 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:54.907076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" Jul 06 15:22:55.033989 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:55.033964 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd"] Jul 06 15:22:55.035816 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:22:55.035790 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5571d74e_7db6_4b2d_b969_459e1db8df4a.slice/crio-17c849d07e9ffe2fa7da9d04a71a4ee8164583c842cb9014d5f23c28cb9a313c WatchSource:0}: Error finding container 17c849d07e9ffe2fa7da9d04a71a4ee8164583c842cb9014d5f23c28cb9a313c: Status 404 returned error can't find the container with id 17c849d07e9ffe2fa7da9d04a71a4ee8164583c842cb9014d5f23c28cb9a313c Jul 06 15:22:55.733809 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:55.733778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" event={"ID":"5571d74e-7db6-4b2d-b969-459e1db8df4a","Type":"ContainerStarted","Data":"17c849d07e9ffe2fa7da9d04a71a4ee8164583c842cb9014d5f23c28cb9a313c"} Jul 06 15:22:57.745985 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:57.745949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" event={"ID":"5571d74e-7db6-4b2d-b969-459e1db8df4a","Type":"ContainerStarted","Data":"f147cddda2ad788914f5aa7300e0224589b9dd011ae9a0f02b76bd9423599adb"} Jul 06 15:22:57.772208 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:22:57.772158 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wmcwd" podStartSLOduration=1.7821738580000002 podStartE2EDuration="3.772143358s" totalImagesPullingTime="1.9899695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:22:57.770887503 +0000 UTC m=+344.081259610" watchObservedRunningTime="2026-07-06 15:22:57.772143358 +0000 UTC m=+344.082515470" Jul 06 15:23:00.213916 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.213889 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv"] Jul 06 15:23:00.216491 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.216472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.220934 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.220914 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:23:00.222078 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.222057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:23:00.222173 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.222084 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7rqd\"" Jul 06 15:23:00.228857 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.228821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv"] Jul 06 15:23:00.305967 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.305939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.306118 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.305972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.306118 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.306049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj77z\" (UniqueName: \"kubernetes.io/projected/3d99d8ce-55e3-405d-8991-9ed15de5a681-kube-api-access-sj77z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.407237 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.407204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj77z\" (UniqueName: \"kubernetes.io/projected/3d99d8ce-55e3-405d-8991-9ed15de5a681-kube-api-access-sj77z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.407396 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.407282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.407396 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.407315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.407651 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.407631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.407715 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.407666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.416887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.416863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj77z\" (UniqueName: \"kubernetes.io/projected/3d99d8ce-55e3-405d-8991-9ed15de5a681-kube-api-access-sj77z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.526006 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.525972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:00.655725 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.655630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv"] Jul 06 15:23:00.658475 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:23:00.658450 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d99d8ce_55e3_405d_8991_9ed15de5a681.slice/crio-e2501584117ee2595ba16a3ca0bf66212141f0b172f3cbc7125a61ca110add92 WatchSource:0}: Error finding container e2501584117ee2595ba16a3ca0bf66212141f0b172f3cbc7125a61ca110add92: Status 404 returned error can't find the container with id e2501584117ee2595ba16a3ca0bf66212141f0b172f3cbc7125a61ca110add92 Jul 06 15:23:00.762261 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.762235 2579 generic.go:356] "Generic (PLEG): container finished" podID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerID="c3d607dac5f3c2d599335fd40d59977da0a01b4437d2c59851272fce14defc74" exitCode=0 Jul 06 15:23:00.762375 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.762316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" event={"ID":"3d99d8ce-55e3-405d-8991-9ed15de5a681","Type":"ContainerDied","Data":"c3d607dac5f3c2d599335fd40d59977da0a01b4437d2c59851272fce14defc74"} Jul 06 15:23:00.762375 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:00.762368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" event={"ID":"3d99d8ce-55e3-405d-8991-9ed15de5a681","Type":"ContainerStarted","Data":"e2501584117ee2595ba16a3ca0bf66212141f0b172f3cbc7125a61ca110add92"} Jul 06 15:23:01.768416 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:01.768386 2579 generic.go:356] "Generic (PLEG): container finished" podID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerID="31d1bcf0d4d4fe197bb2c4c451ae285bee1527c0b181fa5addbe85b9d0927e1b" exitCode=0 Jul 06 15:23:01.768802 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:01.768477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" event={"ID":"3d99d8ce-55e3-405d-8991-9ed15de5a681","Type":"ContainerDied","Data":"31d1bcf0d4d4fe197bb2c4c451ae285bee1527c0b181fa5addbe85b9d0927e1b"} Jul 06 15:23:02.778275 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:02.778244 2579 generic.go:356] "Generic (PLEG): container finished" podID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerID="0b339af96e302d677dad90789234bc2adef1708e85f591c3134d20bf9ffc7480" exitCode=0 Jul 06 15:23:02.778275 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:02.778280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" event={"ID":"3d99d8ce-55e3-405d-8991-9ed15de5a681","Type":"ContainerDied","Data":"0b339af96e302d677dad90789234bc2adef1708e85f591c3134d20bf9ffc7480"} Jul 06 15:23:03.910008 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.909979 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:03.934920 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.934897 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj77z\" (UniqueName: \"kubernetes.io/projected/3d99d8ce-55e3-405d-8991-9ed15de5a681-kube-api-access-sj77z\") pod \"3d99d8ce-55e3-405d-8991-9ed15de5a681\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " Jul 06 15:23:03.935045 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.935003 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-bundle\") pod \"3d99d8ce-55e3-405d-8991-9ed15de5a681\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " Jul 06 15:23:03.935045 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.935018 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-util\") pod \"3d99d8ce-55e3-405d-8991-9ed15de5a681\" (UID: \"3d99d8ce-55e3-405d-8991-9ed15de5a681\") " Jul 06 15:23:03.935877 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.935850 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-bundle" (OuterVolumeSpecName: "bundle") pod "3d99d8ce-55e3-405d-8991-9ed15de5a681" (UID: "3d99d8ce-55e3-405d-8991-9ed15de5a681"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:23:03.936902 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.936867 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d99d8ce-55e3-405d-8991-9ed15de5a681-kube-api-access-sj77z" (OuterVolumeSpecName: "kube-api-access-sj77z") pod "3d99d8ce-55e3-405d-8991-9ed15de5a681" (UID: "3d99d8ce-55e3-405d-8991-9ed15de5a681"). InnerVolumeSpecName "kube-api-access-sj77z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:23:03.943568 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:03.943543 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-util" (OuterVolumeSpecName: "util") pod "3d99d8ce-55e3-405d-8991-9ed15de5a681" (UID: "3d99d8ce-55e3-405d-8991-9ed15de5a681"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:23:04.036405 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:04.036345 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-bundle\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:23:04.036405 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:04.036368 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d99d8ce-55e3-405d-8991-9ed15de5a681-util\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:23:04.036405 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:04.036377 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj77z\" (UniqueName: \"kubernetes.io/projected/3d99d8ce-55e3-405d-8991-9ed15de5a681-kube-api-access-sj77z\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:23:04.790222 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:04.790191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" event={"ID":"3d99d8ce-55e3-405d-8991-9ed15de5a681","Type":"ContainerDied","Data":"e2501584117ee2595ba16a3ca0bf66212141f0b172f3cbc7125a61ca110add92"} Jul 06 15:23:04.790222 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:04.790224 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrwpv" Jul 06 15:23:04.790423 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:04.790235 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2501584117ee2595ba16a3ca0bf66212141f0b172f3cbc7125a61ca110add92" Jul 06 15:23:17.728984 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.728941 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw"] Jul 06 15:23:17.729555 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729446 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="extract" Jul 06 15:23:17.729555 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729466 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="extract" Jul 06 15:23:17.729555 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729481 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="pull" Jul 06 15:23:17.729555 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729490 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="pull" Jul 06 15:23:17.729555 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729528 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="util" Jul 06 15:23:17.729555 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729539 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="util" Jul 06 15:23:17.729936 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.729620 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d99d8ce-55e3-405d-8991-9ed15de5a681" containerName="extract" Jul 06 15:23:17.737528 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.737508 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.744767 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:23:17.744722 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" Jul 06 15:23:17.745520 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.745497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 15:23:17.745623 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.745537 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 15:23:17.745623 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:23:17.745548 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret" Jul 06 15:23:17.745623 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:23:17.745529 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" podUID="946a49e9-2283-47f3-89b7-3068a1b28a23" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.745771 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:23:17.745623 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-8n8jq\" is forbidden: User \"system:node:ip-10-0-129-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8n8jq\"" type="*v1.Secret" Jul 06 15:23:17.784021 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.783991 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw"] Jul 06 15:23:17.847398 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.847360 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/946a49e9-2283-47f3-89b7-3068a1b28a23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.847545 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.847434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/946a49e9-2283-47f3-89b7-3068a1b28a23-tmp\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.847545 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.847479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/946a49e9-2283-47f3-89b7-3068a1b28a23-webhook-cert\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.847545 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.847499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b96b\" (UniqueName: \"kubernetes.io/projected/946a49e9-2283-47f3-89b7-3068a1b28a23-kube-api-access-7b96b\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.847545 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.847517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/946a49e9-2283-47f3-89b7-3068a1b28a23-manifests\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.948228 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.948194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/946a49e9-2283-47f3-89b7-3068a1b28a23-webhook-cert\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.948228 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.948233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b96b\" (UniqueName: \"kubernetes.io/projected/946a49e9-2283-47f3-89b7-3068a1b28a23-kube-api-access-7b96b\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.948461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.948260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/946a49e9-2283-47f3-89b7-3068a1b28a23-manifests\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.948461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.948320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/946a49e9-2283-47f3-89b7-3068a1b28a23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.948461 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.948371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/946a49e9-2283-47f3-89b7-3068a1b28a23-tmp\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.948695 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.948672 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/946a49e9-2283-47f3-89b7-3068a1b28a23-manifests\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.950524 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.950505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/946a49e9-2283-47f3-89b7-3068a1b28a23-tmp\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:17.967261 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:17.967240 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b96b\" (UniqueName: \"kubernetes.io/projected/946a49e9-2283-47f3-89b7-3068a1b28a23-kube-api-access-7b96b\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:18.624936 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:18.624900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 15:23:18.921522 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:18.921441 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 15:23:18.931489 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:18.931460 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/946a49e9-2283-47f3-89b7-3068a1b28a23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:18.931666 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:18.931642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/946a49e9-2283-47f3-89b7-3068a1b28a23-webhook-cert\") pod \"opendatahub-operator-controller-manager-9957545c6-z6rfw\" (UID: \"946a49e9-2283-47f3-89b7-3068a1b28a23\") " pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:19.230362 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:19.230275 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8n8jq\"" Jul 06 15:23:19.237801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:19.237770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:19.373826 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:19.373804 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw"] Jul 06 15:23:19.375570 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:23:19.375543 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946a49e9_2283_47f3_89b7_3068a1b28a23.slice/crio-ff7686178e5fa570946c2466237d979a6e573b54ee4de5ed1e1cc1f9922cc565 WatchSource:0}: Error finding container ff7686178e5fa570946c2466237d979a6e573b54ee4de5ed1e1cc1f9922cc565: Status 404 returned error can't find the container with id ff7686178e5fa570946c2466237d979a6e573b54ee4de5ed1e1cc1f9922cc565 Jul 06 15:23:19.862984 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:19.862952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" event={"ID":"946a49e9-2283-47f3-89b7-3068a1b28a23","Type":"ContainerStarted","Data":"ff7686178e5fa570946c2466237d979a6e573b54ee4de5ed1e1cc1f9922cc565"} Jul 06 15:23:22.882292 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:22.882251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" event={"ID":"946a49e9-2283-47f3-89b7-3068a1b28a23","Type":"ContainerStarted","Data":"3a1c87abd313e210e6f7c0246cf63371148b95552614b9f1c09836f0df20af08"} Jul 06 15:23:23.888611 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:23.888580 2579 generic.go:356] "Generic (PLEG): container finished" podID="946a49e9-2283-47f3-89b7-3068a1b28a23" containerID="3a1c87abd313e210e6f7c0246cf63371148b95552614b9f1c09836f0df20af08" exitCode=0 Jul 06 15:23:23.889003 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:23.888653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" event={"ID":"946a49e9-2283-47f3-89b7-3068a1b28a23","Type":"ContainerDied","Data":"3a1c87abd313e210e6f7c0246cf63371148b95552614b9f1c09836f0df20af08"} Jul 06 15:23:24.895361 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:24.895323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" event={"ID":"946a49e9-2283-47f3-89b7-3068a1b28a23","Type":"ContainerStarted","Data":"030e48f216a3e2c256557c5a49894a05f77cb9f2b61f9ecb9eb864d3e2a51ad6"} Jul 06 15:23:24.895820 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:24.895443 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:24.947934 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:24.947883 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" podStartSLOduration=3.677379106 podStartE2EDuration="7.947867052s" totalImagesPullingTime="3.195646659s" totalInitContainerRuntime="1.074841287s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:23:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:23:24.947823326 +0000 UTC m=+371.258195448" watchObservedRunningTime="2026-07-06 15:23:24.947867052 +0000 UTC m=+371.258239161" Jul 06 15:23:35.902561 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:35.902530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9957545c6-z6rfw" Jul 06 15:23:38.631457 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.631423 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c"] Jul 06 15:23:38.634878 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.634855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.639734 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.639704 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 15:23:38.639734 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.639723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 15:23:38.639945 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.639724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 15:23:38.639945 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.639772 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 15:23:38.639945 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.639704 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dkl65\"" Jul 06 15:23:38.653303 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.653276 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c"] Jul 06 15:23:38.722369 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.722340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txwt\" (UniqueName: \"kubernetes.io/projected/69d07187-b933-4316-8dc7-4cfe266b695e-kube-api-access-7txwt\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.722482 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.722376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69d07187-b933-4316-8dc7-4cfe266b695e-tls-certs\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.722482 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.722396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d07187-b933-4316-8dc7-4cfe266b695e-tmp\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.823534 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.823497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txwt\" (UniqueName: \"kubernetes.io/projected/69d07187-b933-4316-8dc7-4cfe266b695e-kube-api-access-7txwt\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.823534 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.823533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69d07187-b933-4316-8dc7-4cfe266b695e-tls-certs\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.823727 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.823564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d07187-b933-4316-8dc7-4cfe266b695e-tmp\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.825799 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.825779 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d07187-b933-4316-8dc7-4cfe266b695e-tmp\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.826037 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.826018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69d07187-b933-4316-8dc7-4cfe266b695e-tls-certs\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.857460 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.857431 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txwt\" (UniqueName: \"kubernetes.io/projected/69d07187-b933-4316-8dc7-4cfe266b695e-kube-api-access-7txwt\") pod \"kube-auth-proxy-577f8bd98b-h5j6c\" (UID: \"69d07187-b933-4316-8dc7-4cfe266b695e\") " pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:38.944003 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:38.943928 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" Jul 06 15:23:39.122314 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:23:39.122281 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d07187_b933_4316_8dc7_4cfe266b695e.slice/crio-0f50cb0e1a9e7d1d4ab3da821d93bceb692257254475b82e79402ee51a2e6ff8 WatchSource:0}: Error finding container 0f50cb0e1a9e7d1d4ab3da821d93bceb692257254475b82e79402ee51a2e6ff8: Status 404 returned error can't find the container with id 0f50cb0e1a9e7d1d4ab3da821d93bceb692257254475b82e79402ee51a2e6ff8 Jul 06 15:23:39.124082 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:39.124058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c"] Jul 06 15:23:39.968899 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:39.968852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" event={"ID":"69d07187-b933-4316-8dc7-4cfe266b695e","Type":"ContainerStarted","Data":"0f50cb0e1a9e7d1d4ab3da821d93bceb692257254475b82e79402ee51a2e6ff8"} Jul 06 15:23:40.048427 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.048389 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pr6br"] Jul 06 15:23:40.063104 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.063068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.067339 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.067311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 15:23:40.072625 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.072600 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pr6br"] Jul 06 15:23:40.135689 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.135657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmvq8\" (UniqueName: \"kubernetes.io/projected/c21891ef-d07d-4ddf-b5e6-06c035ba9e6a-kube-api-access-vmvq8\") pod \"model-serving-api-54d89bd5fc-pr6br\" (UID: \"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a\") " pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.135954 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.135936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c21891ef-d07d-4ddf-b5e6-06c035ba9e6a-tls-certs\") pod \"model-serving-api-54d89bd5fc-pr6br\" (UID: \"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a\") " pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.237431 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.237357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c21891ef-d07d-4ddf-b5e6-06c035ba9e6a-tls-certs\") pod \"model-serving-api-54d89bd5fc-pr6br\" (UID: \"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a\") " pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.237565 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.237440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmvq8\" (UniqueName: \"kubernetes.io/projected/c21891ef-d07d-4ddf-b5e6-06c035ba9e6a-kube-api-access-vmvq8\") pod \"model-serving-api-54d89bd5fc-pr6br\" (UID: \"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a\") " pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.239708 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.239685 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c21891ef-d07d-4ddf-b5e6-06c035ba9e6a-tls-certs\") pod \"model-serving-api-54d89bd5fc-pr6br\" (UID: \"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a\") " pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.251781 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.251760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmvq8\" (UniqueName: \"kubernetes.io/projected/c21891ef-d07d-4ddf-b5e6-06c035ba9e6a-kube-api-access-vmvq8\") pod \"model-serving-api-54d89bd5fc-pr6br\" (UID: \"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a\") " pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.380607 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.380572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:40.518350 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.518324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pr6br"] Jul 06 15:23:40.520213 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:23:40.520187 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21891ef_d07d_4ddf_b5e6_06c035ba9e6a.slice/crio-6de76b3124477c87c2d82b03ef137bd0fbe882b6377012f556ab9a8562f58142 WatchSource:0}: Error finding container 6de76b3124477c87c2d82b03ef137bd0fbe882b6377012f556ab9a8562f58142: Status 404 returned error can't find the container with id 6de76b3124477c87c2d82b03ef137bd0fbe882b6377012f556ab9a8562f58142 Jul 06 15:23:40.980059 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:40.979958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" event={"ID":"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a","Type":"ContainerStarted","Data":"6de76b3124477c87c2d82b03ef137bd0fbe882b6377012f556ab9a8562f58142"} Jul 06 15:23:42.992600 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:42.992555 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" event={"ID":"c21891ef-d07d-4ddf-b5e6-06c035ba9e6a","Type":"ContainerStarted","Data":"ac71dd67d8c9124e4ad234fafa7259053fdba47106ea3ca095d3ed189fb4064b"} Jul 06 15:23:42.993090 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:42.992676 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:23:43.020548 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:43.020503 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" podStartSLOduration=1.059998449 podStartE2EDuration="3.020484514s" totalImagesPullingTime="1.960486065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:23:43.017928936 +0000 UTC m=+389.328301046" watchObservedRunningTime="2026-07-06 15:23:43.020484514 +0000 UTC m=+389.330856602" Jul 06 15:23:44.000863 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:44.000809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" event={"ID":"69d07187-b933-4316-8dc7-4cfe266b695e","Type":"ContainerStarted","Data":"93b08baababf07627170b66cb2e9a6cc067d64fe9bef801595cef7278b71a228"} Jul 06 15:23:44.020208 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:44.020162 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-577f8bd98b-h5j6c" podStartSLOduration=1.540795346 podStartE2EDuration="6.020149363s" totalImagesPullingTime="4.479354017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:23:44.01850318 +0000 UTC m=+390.328875291" watchObservedRunningTime="2026-07-06 15:23:44.020149363 +0000 UTC m=+390.330521473" Jul 06 15:23:47.764310 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.764273 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m"] Jul 06 15:23:47.767889 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.767866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.771427 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.771404 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 15:23:47.771553 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.771438 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 15:23:47.771553 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.771509 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kl8p8\"" Jul 06 15:23:47.771553 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.771545 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 15:23:47.772050 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.772034 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 15:23:47.792362 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.792334 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m"] Jul 06 15:23:47.911041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.911221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skxd7\" (UniqueName: \"kubernetes.io/projected/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-kube-api-access-skxd7\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.911221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.911221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.911221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.911221 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:47.911401 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:47.911241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.012619 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.012768 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skxd7\" (UniqueName: \"kubernetes.io/projected/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-kube-api-access-skxd7\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.012768 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.012768 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.012768 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.013021 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.013021 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.012902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.013456 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.013432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.015148 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.015084 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.015148 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.015095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.015148 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.015117 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.015354 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.015229 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.022402 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.022382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.022874 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.022856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skxd7\" (UniqueName: \"kubernetes.io/projected/7d28be19-d5bd-4e04-ac03-cd25fbd6e01a-kube-api-access-skxd7\") pod \"istiod-openshift-gateway-94bb8fbfd-rv97m\" (UID: \"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.076629 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.076609 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:48.233853 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.233805 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m"] Jul 06 15:23:48.235915 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:23:48.235887 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d28be19_d5bd_4e04_ac03_cd25fbd6e01a.slice/crio-901bf5b9784fd8f6cae8a5b4f987aa3a5bfd25fad5699ec9db9b66e4d02be54c WatchSource:0}: Error finding container 901bf5b9784fd8f6cae8a5b4f987aa3a5bfd25fad5699ec9db9b66e4d02be54c: Status 404 returned error can't find the container with id 901bf5b9784fd8f6cae8a5b4f987aa3a5bfd25fad5699ec9db9b66e4d02be54c Jul 06 15:23:48.912549 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.912474 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx"] Jul 06 15:23:48.918056 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.918030 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:48.921139 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.921115 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 15:23:48.922343 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.922323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pmxsn\"" Jul 06 15:23:48.922343 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.922331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 15:23:48.923006 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.922984 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 15:23:48.936889 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:48.936866 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx"] Jul 06 15:23:49.022537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.022506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f8deb02-1bf8-4add-ac96-7593038fafa0-manager-config\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.022537 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.022550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgp9b\" (UniqueName: \"kubernetes.io/projected/7f8deb02-1bf8-4add-ac96-7593038fafa0-kube-api-access-sgp9b\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.022748 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.022687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f8deb02-1bf8-4add-ac96-7593038fafa0-metrics-cert\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.022748 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.022735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f8deb02-1bf8-4add-ac96-7593038fafa0-cert\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.027298 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.027275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" event={"ID":"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a","Type":"ContainerStarted","Data":"901bf5b9784fd8f6cae8a5b4f987aa3a5bfd25fad5699ec9db9b66e4d02be54c"} Jul 06 15:23:49.123887 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.123826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f8deb02-1bf8-4add-ac96-7593038fafa0-metrics-cert\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.124061 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.123900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f8deb02-1bf8-4add-ac96-7593038fafa0-cert\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.124061 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.124020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f8deb02-1bf8-4add-ac96-7593038fafa0-manager-config\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.124178 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.124064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgp9b\" (UniqueName: \"kubernetes.io/projected/7f8deb02-1bf8-4add-ac96-7593038fafa0-kube-api-access-sgp9b\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.124776 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.124749 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f8deb02-1bf8-4add-ac96-7593038fafa0-manager-config\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.126662 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.126642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f8deb02-1bf8-4add-ac96-7593038fafa0-metrics-cert\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.126801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.126783 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f8deb02-1bf8-4add-ac96-7593038fafa0-cert\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.136885 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.136863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgp9b\" (UniqueName: \"kubernetes.io/projected/7f8deb02-1bf8-4add-ac96-7593038fafa0-kube-api-access-sgp9b\") pod \"lws-controller-manager-59fc8bcc45-m2ggx\" (UID: \"7f8deb02-1bf8-4add-ac96-7593038fafa0\") " pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.230547 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.230475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:49.420625 ip-10-0-129-138 kubenswrapper[2579]: W0706 15:23:49.420587 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8deb02_1bf8_4add_ac96_7593038fafa0.slice/crio-7399ebb17a06dfb2c90139270287c532d5e1eaf65e57886c3662ecdccd528558 WatchSource:0}: Error finding container 7399ebb17a06dfb2c90139270287c532d5e1eaf65e57886c3662ecdccd528558: Status 404 returned error can't find the container with id 7399ebb17a06dfb2c90139270287c532d5e1eaf65e57886c3662ecdccd528558 Jul 06 15:23:49.421259 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:49.421239 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx"] Jul 06 15:23:50.035754 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:50.035707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" event={"ID":"7f8deb02-1bf8-4add-ac96-7593038fafa0","Type":"ContainerStarted","Data":"7399ebb17a06dfb2c90139270287c532d5e1eaf65e57886c3662ecdccd528558"} Jul 06 15:23:51.640673 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:51.640628 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 15:23:51.641057 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:51.640708 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 15:23:52.054570 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.054508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" event={"ID":"7d28be19-d5bd-4e04-ac03-cd25fbd6e01a","Type":"ContainerStarted","Data":"5748c9d5469b50988b14c53dcf8fa00bde396c107f30782861f68f82820d68a2"} Jul 06 15:23:52.054783 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.054596 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:52.056392 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.056342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" event={"ID":"7f8deb02-1bf8-4add-ac96-7593038fafa0","Type":"ContainerStarted","Data":"8dbe3ff85d5194bfb0196d348221bef02acec23bf597f18b50ea83d68a873787"} Jul 06 15:23:52.056574 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.056555 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:23:52.056685 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.056561 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-rv97m container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 15:23:52.056870 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.056715 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" podUID="7d28be19-d5bd-4e04-ac03-cd25fbd6e01a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:23:52.102715 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:52.102633 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" podStartSLOduration=1.7003311760000002 podStartE2EDuration="5.10261276s" totalImagesPullingTime="3.402281584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:23:52.10030255 +0000 UTC m=+398.410674661" watchObservedRunningTime="2026-07-06 15:23:52.10261276 +0000 UTC m=+398.412984871" Jul 06 15:23:53.063265 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:53.063233 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rv97m" Jul 06 15:23:53.098361 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:53.098302 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" podStartSLOduration=2.877917227 podStartE2EDuration="5.09828509s" totalImagesPullingTime="2.220367863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:23:52.17960913 +0000 UTC m=+398.489981239" watchObservedRunningTime="2026-07-06 15:23:53.09828509 +0000 UTC m=+399.408657221" Jul 06 15:23:54.006538 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:23:54.006508 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pr6br" Jul 06 15:24:03.064401 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:24:03.064375 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59fc8bcc45-m2ggx" Jul 06 15:25:24.705927 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:24.705887 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58d99f74c8-4msrq"] Jul 06 15:25:49.726057 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:49.725996 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58d99f74c8-4msrq" podUID="3b63b907-44cf-48c1-9c46-1bf68468db69" containerName="console" containerID="cri-o://c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00" gracePeriod=15 Jul 06 15:25:49.966957 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:49.966934 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:25:50.090503 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090473 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-service-ca\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090503 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090506 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-oauth-serving-cert\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090710 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090524 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-oauth-config\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090710 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090554 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-console-config\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090702 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfwrb\" (UniqueName: \"kubernetes.io/projected/3b63b907-44cf-48c1-9c46-1bf68468db69-kube-api-access-jfwrb\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090801 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090749 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-serving-cert\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090924 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090863 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-trusted-ca-bundle\") pod \"3b63b907-44cf-48c1-9c46-1bf68468db69\" (UID: \"3b63b907-44cf-48c1-9c46-1bf68468db69\") " Jul 06 15:25:50.090984 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090967 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:25:50.091041 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.090992 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:25:50.091096 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.091032 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-console-config" (OuterVolumeSpecName: "console-config") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:25:50.091311 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.091262 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:25:50.091405 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.091330 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-service-ca\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.091405 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.091352 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-oauth-serving-cert\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.091405 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.091367 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-console-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.092736 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.092707 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:25:50.092849 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.092755 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b63b907-44cf-48c1-9c46-1bf68468db69-kube-api-access-jfwrb" (OuterVolumeSpecName: "kube-api-access-jfwrb") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "kube-api-access-jfwrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:25:50.092980 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.092957 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b63b907-44cf-48c1-9c46-1bf68468db69" (UID: "3b63b907-44cf-48c1-9c46-1bf68468db69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:25:50.192067 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.192043 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-oauth-config\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.192067 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.192066 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfwrb\" (UniqueName: \"kubernetes.io/projected/3b63b907-44cf-48c1-9c46-1bf68468db69-kube-api-access-jfwrb\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.192199 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.192075 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b63b907-44cf-48c1-9c46-1bf68468db69-console-serving-cert\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.192199 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.192084 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b63b907-44cf-48c1-9c46-1bf68468db69-trusted-ca-bundle\") on node \"ip-10-0-129-138.ec2.internal\" DevicePath \"\"" Jul 06 15:25:50.667829 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.667793 2579 generic.go:356] "Generic (PLEG): container finished" podID="3b63b907-44cf-48c1-9c46-1bf68468db69" containerID="c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00" exitCode=0 Jul 06 15:25:50.667829 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.667843 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d99f74c8-4msrq" Jul 06 15:25:50.668044 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.667881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d99f74c8-4msrq" event={"ID":"3b63b907-44cf-48c1-9c46-1bf68468db69","Type":"ContainerDied","Data":"c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00"} Jul 06 15:25:50.668044 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.667935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d99f74c8-4msrq" event={"ID":"3b63b907-44cf-48c1-9c46-1bf68468db69","Type":"ContainerDied","Data":"9186d378f6e4cd47953c708d8b5a920fd8a7f4b42071511e6cc86d2ed039a30a"} Jul 06 15:25:50.668044 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.667958 2579 scope.go:117] "RemoveContainer" containerID="c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00" Jul 06 15:25:50.676506 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.676487 2579 scope.go:117] "RemoveContainer" containerID="c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00" Jul 06 15:25:50.676744 ip-10-0-129-138 kubenswrapper[2579]: E0706 15:25:50.676723 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00\": container with ID starting with c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00 not found: ID does not exist" containerID="c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00" Jul 06 15:25:50.676806 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.676752 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00"} err="failed to get container status \"c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00\": rpc error: code = NotFound desc = could not find container \"c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00\": container with ID starting with c7b05f16f285ef6aeb3c6476c7814bca44efaa9906b5c3eb2a1b72e4c90f0c00 not found: ID does not exist" Jul 06 15:25:50.698256 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.698230 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58d99f74c8-4msrq"] Jul 06 15:25:50.701870 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:50.701848 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58d99f74c8-4msrq"] Jul 06 15:25:52.167052 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:25:52.167024 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b63b907-44cf-48c1-9c46-1bf68468db69" path="/var/lib/kubelet/pods/3b63b907-44cf-48c1-9c46-1bf68468db69/volumes" Jul 06 15:27:14.088667 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:27:14.088637 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:27:14.091091 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:27:14.091068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:32:14.129592 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:32:14.129565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:32:14.130591 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:32:14.130572 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:37:14.162922 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:37:14.162890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:37:14.170640 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:37:14.170616 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:42:14.195072 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:42:14.195040 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:42:14.204317 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:42:14.204296 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:47:14.227110 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:47:14.227068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:47:14.238318 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:47:14.238295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:52:14.259079 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:52:14.259046 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:52:14.272375 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:52:14.272355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:57:14.292776 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:57:14.292749 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:57:14.305671 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:57:14.305643 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 15:59:57.487332 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:59:57.487302 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pr6br_c21891ef-d07d-4ddf-b5e6-06c035ba9e6a/server/0.log" Jul 06 15:59:57.988497 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:59:57.988468 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9957545c6-z6rfw_946a49e9-2283-47f3-89b7-3068a1b28a23/copy-manifests/0.log" Jul 06 15:59:57.996995 ip-10-0-129-138 kubenswrapper[2579]: I0706 15:59:57.996969 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9957545c6-z6rfw_946a49e9-2283-47f3-89b7-3068a1b28a23/manager/0.log" Jul 06 16:00:00.950947 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:00.950913 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rv97m_7d28be19-d5bd-4e04-ac03-cd25fbd6e01a/discovery/0.log" Jul 06 16:00:01.088843 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:01.088812 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577f8bd98b-h5j6c_69d07187-b933-4316-8dc7-4cfe266b695e/kube-auth-proxy/0.log" Jul 06 16:00:10.813225 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:10.813192 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tsxrq_66229ceb-f969-42be-a399-f698f9b35d29/global-pull-secret-syncer/0.log" Jul 06 16:00:10.973511 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:10.973484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kb8dz_c768c2a9-fb9b-45ce-b420-e212167f77ad/konnectivity-agent/0.log" Jul 06 16:00:11.001432 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:11.001394 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-138.ec2.internal_e6d8edb6dd5142fb60606870efd8df86/haproxy/0.log" Jul 06 16:00:18.054437 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.054411 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/alertmanager/0.log" Jul 06 16:00:18.080869 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.080848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/config-reloader/0.log" Jul 06 16:00:18.113032 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.113009 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/kube-rbac-proxy-web/0.log" Jul 06 16:00:18.139916 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.139890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/kube-rbac-proxy/0.log" Jul 06 16:00:18.161542 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.161513 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/kube-rbac-proxy-metric/0.log" Jul 06 16:00:18.186705 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.186687 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/prom-label-proxy/0.log" Jul 06 16:00:18.211110 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.211089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a933678f-f5a6-49ae-9a88-e08038515792/init-config-reloader/0.log" Jul 06 16:00:18.271535 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.271511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/1.log" Jul 06 16:00:18.417266 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.417182 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7t8gj_6c021b29-a87e-40d1-832a-b56bc9d6c3cf/cluster-monitoring-operator/0.log" Jul 06 16:00:18.449110 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.449074 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-sfbz5_bc79e247-2bd3-477f-92fa-3ecccc71c06b/kube-state-metrics/0.log" Jul 06 16:00:18.477812 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.477789 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-sfbz5_bc79e247-2bd3-477f-92fa-3ecccc71c06b/kube-rbac-proxy-main/0.log" Jul 06 16:00:18.503910 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.503888 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-sfbz5_bc79e247-2bd3-477f-92fa-3ecccc71c06b/kube-rbac-proxy-self/0.log" Jul 06 16:00:18.703197 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.703119 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8d2x_172a6e65-6d61-4cc1-8eea-fa7a2f103724/node-exporter/0.log" Jul 06 16:00:18.725855 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.725810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8d2x_172a6e65-6d61-4cc1-8eea-fa7a2f103724/kube-rbac-proxy/0.log" Jul 06 16:00:18.759763 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.759742 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8d2x_172a6e65-6d61-4cc1-8eea-fa7a2f103724/init-textfile/0.log" Jul 06 16:00:18.899959 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.899930 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-vxwg4_81e9939d-4051-46d7-8556-b3fba19b07f9/kube-rbac-proxy-main/0.log" Jul 06 16:00:18.931505 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.931478 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-vxwg4_81e9939d-4051-46d7-8556-b3fba19b07f9/kube-rbac-proxy-self/0.log" Jul 06 16:00:18.966373 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:18.966312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-vxwg4_81e9939d-4051-46d7-8556-b3fba19b07f9/openshift-state-metrics/0.log" Jul 06 16:00:19.265055 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.265025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tdsb7_59f34d11-e828-4225-b885-e6fe76e93dfd/prometheus-operator/0.log" Jul 06 16:00:19.287777 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.287760 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tdsb7_59f34d11-e828-4225-b885-e6fe76e93dfd/kube-rbac-proxy/0.log" Jul 06 16:00:19.318647 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.318628 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-lhdlq_ee502d02-3d5b-4b4d-933d-0d5ca700e93d/prometheus-operator-admission-webhook/0.log" Jul 06 16:00:19.353157 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.353139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-648fd75d6c-g8m97_97013c50-151a-41f5-97d0-9e1239aa3b97/telemeter-client/0.log" Jul 06 16:00:19.377246 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.377225 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-648fd75d6c-g8m97_97013c50-151a-41f5-97d0-9e1239aa3b97/reload/0.log" Jul 06 16:00:19.400318 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.400294 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-648fd75d6c-g8m97_97013c50-151a-41f5-97d0-9e1239aa3b97/kube-rbac-proxy/0.log" Jul 06 16:00:19.432763 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.432746 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7944d9d444-lh4lk_b471a00a-90bc-457f-8bc1-e59da41d52b5/thanos-query/0.log" Jul 06 16:00:19.457759 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.457743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7944d9d444-lh4lk_b471a00a-90bc-457f-8bc1-e59da41d52b5/kube-rbac-proxy-web/0.log" Jul 06 16:00:19.482508 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.482482 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7944d9d444-lh4lk_b471a00a-90bc-457f-8bc1-e59da41d52b5/kube-rbac-proxy/0.log" Jul 06 16:00:19.507343 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.507322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7944d9d444-lh4lk_b471a00a-90bc-457f-8bc1-e59da41d52b5/prom-label-proxy/0.log" Jul 06 16:00:19.532080 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.532025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7944d9d444-lh4lk_b471a00a-90bc-457f-8bc1-e59da41d52b5/kube-rbac-proxy-rules/0.log" Jul 06 16:00:19.561448 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:19.561423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7944d9d444-lh4lk_b471a00a-90bc-457f-8bc1-e59da41d52b5/kube-rbac-proxy-metrics/0.log" Jul 06 16:00:20.673685 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.673648 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv"] Jul 06 16:00:20.674073 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.674062 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b63b907-44cf-48c1-9c46-1bf68468db69" containerName="console" Jul 06 16:00:20.674073 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.674074 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b63b907-44cf-48c1-9c46-1bf68468db69" containerName="console" Jul 06 16:00:20.674165 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.674133 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b63b907-44cf-48c1-9c46-1bf68468db69" containerName="console" Jul 06 16:00:20.677477 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.677454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.680749 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.680714 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjbpc\"/\"default-dockercfg-mpklm\"" Jul 06 16:00:20.680888 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.680783 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjbpc\"/\"openshift-service-ca.crt\"" Jul 06 16:00:20.681884 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.681865 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjbpc\"/\"kube-root-ca.crt\"" Jul 06 16:00:20.694311 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.694291 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv"] Jul 06 16:00:20.695587 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.695568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-lib-modules\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.695679 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.695599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9245q\" (UniqueName: \"kubernetes.io/projected/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-kube-api-access-9245q\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.695679 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.695630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-podres\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.695772 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.695740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-sys\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.695890 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.695873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-proc\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.767304 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.767276 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-cr6zq_e1085eee-84f1-4a48-b4c1-e77ae33a5ca2/networking-console-plugin/0.log" Jul 06 16:00:20.797194 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-sys\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797332 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-proc\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797332 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-lib-modules\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797332 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9245q\" (UniqueName: \"kubernetes.io/projected/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-kube-api-access-9245q\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797332 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-sys\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797332 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-podres\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797543 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-proc\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797543 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-lib-modules\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.797543 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.797480 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-podres\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.813334 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.813311 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9245q\" (UniqueName: \"kubernetes.io/projected/a9524f2e-08ee-4770-a8f0-6d47b9e21ff7-kube-api-access-9245q\") pod \"perf-node-gather-daemonset-29fcv\" (UID: \"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7\") " pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:20.987333 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:20.987232 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:21.123494 ip-10-0-129-138 kubenswrapper[2579]: W0706 16:00:21.123462 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9524f2e_08ee_4770_a8f0_6d47b9e21ff7.slice/crio-6b361fd93a88bad5ed75f68364728991e9b47f4c40ab4e0535f29d1c54f78000 WatchSource:0}: Error finding container 6b361fd93a88bad5ed75f68364728991e9b47f4c40ab4e0535f29d1c54f78000: Status 404 returned error can't find the container with id 6b361fd93a88bad5ed75f68364728991e9b47f4c40ab4e0535f29d1c54f78000 Jul 06 16:00:21.124164 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:21.124138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv"] Jul 06 16:00:22.000891 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:22.000859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" event={"ID":"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7","Type":"ContainerStarted","Data":"60c1a4f1bb2c1640cca28e32d495dc938f1f388c64fc26f63668e31aba4440a9"} Jul 06 16:00:22.001330 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:22.000914 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" event={"ID":"a9524f2e-08ee-4770-a8f0-6d47b9e21ff7","Type":"ContainerStarted","Data":"6b361fd93a88bad5ed75f68364728991e9b47f4c40ab4e0535f29d1c54f78000"} Jul 06 16:00:22.001330 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:22.000949 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:22.019541 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:22.019496 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" podStartSLOduration=2.019481217 podStartE2EDuration="2.019481217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:00:22.017514564 +0000 UTC m=+2588.327886678" watchObservedRunningTime="2026-07-06 16:00:22.019481217 +0000 UTC m=+2588.329853327" Jul 06 16:00:22.035967 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:22.035945 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-lj56n_3205d4ba-455a-4490-bf13-d632c0588792/download-server/0.log" Jul 06 16:00:22.620101 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:22.620067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-tncrp_774a2c39-e5f9-417d-a790-20e742abe2a0/volume-data-source-validator/0.log" Jul 06 16:00:23.756773 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:23.756738 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8wqz_3ac69126-e7ad-4d08-bf6f-f7d0288b61ab/dns/0.log" Jul 06 16:00:23.783807 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:23.783781 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8wqz_3ac69126-e7ad-4d08-bf6f-f7d0288b61ab/kube-rbac-proxy/0.log" Jul 06 16:00:23.930709 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:23.930680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4289_f0a1f690-c1ef-424c-88bb-d9996e4ac694/dns-node-resolver/0.log" Jul 06 16:00:24.654884 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:24.654856 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qxhg_7d1d14f2-41fc-497f-accb-37200a7b7d79/node-ca/0.log" Jul 06 16:00:25.935571 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:25.935538 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rv97m_7d28be19-d5bd-4e04-ac03-cd25fbd6e01a/discovery/0.log" Jul 06 16:00:25.965735 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:25.965711 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577f8bd98b-h5j6c_69d07187-b933-4316-8dc7-4cfe266b695e/kube-auth-proxy/0.log" Jul 06 16:00:27.040800 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:27.040761 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x5js5_7fab1e20-88ea-4555-87f2-d3aca283cee6/serve-healthcheck-canary/0.log" Jul 06 16:00:27.972487 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:27.972458 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzhcz_c7216ac0-2980-4c54-9a72-53051c1e6908/kube-rbac-proxy/0.log" Jul 06 16:00:28.003297 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:28.003252 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzhcz_c7216ac0-2980-4c54-9a72-53051c1e6908/exporter/0.log" Jul 06 16:00:28.023660 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:28.023638 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjbpc/perf-node-gather-daemonset-29fcv" Jul 06 16:00:28.028867 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:28.028822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzhcz_c7216ac0-2980-4c54-9a72-53051c1e6908/extractor/0.log" Jul 06 16:00:31.101097 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:31.101075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pr6br_c21891ef-d07d-4ddf-b5e6-06c035ba9e6a/server/0.log" Jul 06 16:00:31.339233 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:31.339154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rv97m_7d28be19-d5bd-4e04-ac03-cd25fbd6e01a/discovery/0.log" Jul 06 16:00:31.402362 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:31.402329 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577f8bd98b-h5j6c_69d07187-b933-4316-8dc7-4cfe266b695e/kube-auth-proxy/0.log" Jul 06 16:00:31.548914 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:31.548878 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9957545c6-z6rfw_946a49e9-2283-47f3-89b7-3068a1b28a23/manager/0.log" Jul 06 16:00:31.571719 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:31.571693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9957545c6-z6rfw_946a49e9-2283-47f3-89b7-3068a1b28a23/copy-manifests/0.log" Jul 06 16:00:33.035571 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:33.035538 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rv97m_7d28be19-d5bd-4e04-ac03-cd25fbd6e01a/discovery/0.log" Jul 06 16:00:33.052558 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:33.052537 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577f8bd98b-h5j6c_69d07187-b933-4316-8dc7-4cfe266b695e/kube-auth-proxy/0.log" Jul 06 16:00:33.099039 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:33.099010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59fc8bcc45-m2ggx_7f8deb02-1bf8-4add-ac96-7593038fafa0/manager/0.log" Jul 06 16:00:33.130520 ip-10-0-129-138 kubenswrapper[2579]: I0706 16:00:33.130492 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wmcwd_5571d74e-7db6-4b2d-b969-459e1db8df4a/openshift-lws-operator/0.log"