Jul 23 18:04:25.754568 ip-10-0-129-157 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 18:04:25.754580 ip-10-0-129-157 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 18:04:25.754587 ip-10-0-129-157 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 18:04:25.754823 ip-10-0-129-157 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 18:04:35.617437 ip-10-0-129-157 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 23 18:04:35.617454 ip-10-0-129-157 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 555a7a74b5a74778bf37adb518f87b62 -- Jul 23 18:06:27.275708 ip-10-0-129-157 systemd[1]: Starting Kubernetes Kubelet... Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.593653 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597652 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597671 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597675 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597678 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597681 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597684 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597687 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:27.664971 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597689 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:27.662280 ip-10-0-129-157 systemd[1]: Started Kubernetes Kubelet. Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597692 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597695 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597698 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597700 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597703 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597707 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597712 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597715 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597718 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597721 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597724 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597737 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597742 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597745 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597748 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597751 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597754 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597758 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:27.673299 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597761 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597763 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597766 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597770 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597773 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597777 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597780 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597783 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597786 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597789 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597792 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597795 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597798 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597800 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597803 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597806 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597808 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597811 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597813 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597816 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:27.674610 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597819 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597821 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597824 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597827 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597829 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597832 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597836 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597839 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597842 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597844 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597847 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597850 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597852 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597855 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597857 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597861 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597864 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597866 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597869 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597871 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:27.675994 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597874 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597876 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597879 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597881 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597884 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597887 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597889 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597892 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597895 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597897 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597900 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597902 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597905 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597907 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597911 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597915 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597918 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597920 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597924 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:27.679221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597927 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597930 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597932 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597935 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597938 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597941 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597943 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597946 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597948 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597951 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597954 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597957 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597959 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.597962 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598714 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598721 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598724 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598727 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598730 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598733 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:27.680284 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598736 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598739 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598741 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598744 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598747 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598750 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598753 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598755 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598757 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598760 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598763 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598766 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598769 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598772 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598777 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598780 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598783 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598786 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598789 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598792 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:27.682367 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598794 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598797 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598800 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598802 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598805 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598807 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598810 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598814 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598818 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598820 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598824 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598827 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598835 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598838 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598841 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598844 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598847 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598850 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598852 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:27.686562 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598855 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598858 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598860 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598863 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598866 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598868 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598871 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598874 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598877 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598880 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598882 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598885 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598888 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598892 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598895 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598898 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598901 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598904 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598908 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598911 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:27.688044 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598914 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598917 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598920 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598923 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598926 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598929 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598932 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598934 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598937 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598940 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598942 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598945 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598947 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598950 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598953 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598955 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598958 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598960 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598962 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598965 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:27.689976 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598968 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598970 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598973 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598976 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598979 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598982 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598984 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598987 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598989 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598992 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598994 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598997 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.598999 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599002 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599453 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599459 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599462 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599465 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599474 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599477 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:27.690731 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599480 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599482 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599485 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599488 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599490 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599493 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599496 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599500 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599504 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599508 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599511 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599514 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599517 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599519 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599522 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599525 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599528 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599531 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599533 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:27.692638 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599536 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599539 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599541 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599544 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599546 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599549 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599556 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599559 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599563 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599566 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599569 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599572 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599580 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599583 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599586 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599589 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599591 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599594 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599598 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599600 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:27.693857 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599603 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599606 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599608 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599611 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599613 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599616 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599619 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599621 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599624 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599626 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599629 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599631 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599634 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599636 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599639 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599641 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599644 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599647 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599652 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599654 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:27.694712 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599658 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599662 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599666 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599669 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599672 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599680 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599683 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599685 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599688 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599690 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599693 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599696 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599698 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599701 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599704 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599706 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599709 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599711 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599715 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:27.695497 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599717 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599720 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599722 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599725 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599727 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599730 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599733 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599735 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599738 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599740 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599743 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599747 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599749 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599753 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.599756 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599847 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599855 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599865 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599870 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599882 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599885 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 18:06:27.696230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599889 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599894 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599898 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599901 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599904 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599908 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599911 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599914 2572 flags.go:64] FLAG: --cgroup-root="" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599917 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599920 2572 flags.go:64] FLAG: --client-ca-file="" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599922 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599925 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599932 2572 flags.go:64] FLAG: --cluster-domain="" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599935 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599938 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599941 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599944 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599948 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599951 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599954 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599958 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599961 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599965 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599969 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 18:06:27.696975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599973 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599976 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599981 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599984 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599987 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599989 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.599993 2572 flags.go:64] FLAG: --enable-server="true" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600002 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600009 2572 flags.go:64] FLAG: --event-burst="100" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600012 2572 flags.go:64] FLAG: --event-qps="50" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600015 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600018 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600021 2572 flags.go:64] FLAG: --eviction-hard="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600025 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600028 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600031 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600034 2572 flags.go:64] FLAG: --eviction-soft="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600045 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600048 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600051 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600054 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600057 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600060 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600063 2572 flags.go:64] FLAG: --feature-gates="" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600067 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 18:06:27.697753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600070 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600073 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600077 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600080 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600083 2572 flags.go:64] FLAG: --help="false" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600087 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-129-157.ec2.internal" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600090 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600095 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600098 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600101 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600105 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600107 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600110 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600113 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600116 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600125 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600129 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600131 2572 flags.go:64] FLAG: --kube-reserved="" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600135 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600138 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600141 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600144 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600147 2572 flags.go:64] FLAG: --lock-file="" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600150 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 18:06:27.698528 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600153 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600156 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600162 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600165 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600167 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600170 2572 flags.go:64] FLAG: --logging-format="text" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600173 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600176 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600179 2572 flags.go:64] FLAG: --manifest-url="" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600182 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600186 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600190 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600194 2572 flags.go:64] FLAG: --max-pods="110" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600198 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600201 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600208 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600211 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600214 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600217 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600219 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600227 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600230 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600233 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 18:06:27.699269 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600236 2572 flags.go:64] FLAG: --pod-cidr="" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600248 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600256 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600259 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600262 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600266 2572 flags.go:64] FLAG: --port="10250" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600269 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600272 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b28d8050891ec07" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600275 2572 flags.go:64] FLAG: --qos-reserved="" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600278 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600281 2572 flags.go:64] FLAG: --register-node="true" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600284 2572 flags.go:64] FLAG: --register-with-taints="" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600287 2572 flags.go:64] FLAG: --registry-burst="10" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600290 2572 flags.go:64] FLAG: --registry-qps="5" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600293 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600296 2572 flags.go:64] FLAG: --reserved-memory="" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600299 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600303 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600306 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600309 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600311 2572 flags.go:64] FLAG: --runonce="false" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600314 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600317 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600322 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600327 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 18:06:27.700003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600330 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600333 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600353 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600357 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600360 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600363 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600366 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600369 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600372 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600381 2572 flags.go:64] FLAG: --system-cgroups="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600384 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600390 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600393 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600396 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600402 2572 flags.go:64] FLAG: --tls-min-version="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600405 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600408 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600411 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600414 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600417 2572 flags.go:64] FLAG: --v="2" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600421 2572 flags.go:64] FLAG: --version="false" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600425 2572 flags.go:64] FLAG: --vmodule="" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600429 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600433 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 18:06:27.700769 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600578 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600583 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600587 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600590 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600593 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600596 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600600 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600604 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600606 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600609 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600611 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600616 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600619 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600622 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600625 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600628 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600631 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600634 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600642 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600645 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:27.701538 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600648 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600650 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600653 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600656 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600658 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600661 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600664 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600666 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600669 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600671 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600674 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600677 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600679 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600683 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600687 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600690 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600693 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600696 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600700 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600704 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:27.797083 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600707 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600709 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600713 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600715 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600718 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600720 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600723 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600726 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600729 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600731 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600734 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600743 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600746 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600749 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600751 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600754 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600756 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600759 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600762 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:27.798263 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600764 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600767 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600769 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600772 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600774 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600777 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600780 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600782 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600785 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600787 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600790 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600794 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600798 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600800 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600803 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600805 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600808 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600810 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600813 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600816 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:27.800771 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600818 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600821 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600824 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600826 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600829 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600837 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600840 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600842 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600845 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600847 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600850 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600853 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600855 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600858 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600860 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600863 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600866 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600868 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600871 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:27.801598 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.600873 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.600882 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.608459 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.608483 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.609060 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.609068 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609150 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609157 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609160 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609163 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609166 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609169 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609171 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609174 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609177 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:27.803288 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609181 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609184 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609186 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609189 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609191 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609194 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609196 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609200 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609203 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609205 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609208 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609210 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609213 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609220 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609223 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609225 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609228 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609230 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609233 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609236 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:27.804144 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609244 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609247 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609250 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609252 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609255 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609257 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609261 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609263 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609266 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609274 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609277 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609279 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609282 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609284 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609287 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609290 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609294 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609299 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609301 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609304 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:27.804983 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609307 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609310 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609312 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609315 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609317 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609322 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609324 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609327 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609330 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609332 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609335 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609354 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609357 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609366 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609369 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609371 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609374 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609376 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609379 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:27.805838 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609382 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609384 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609389 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609391 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609394 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609397 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609399 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609402 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609404 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609407 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609410 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609412 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609416 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609418 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609421 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609423 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609426 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609428 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609433 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609435 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:27.806675 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609438 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609442 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609446 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609449 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609451 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609454 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609457 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609466 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609468 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609473 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609477 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.609482 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609653 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609659 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:27.808779 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609663 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609666 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609669 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609672 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609675 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609677 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609680 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609682 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609685 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609687 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609690 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609693 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609697 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609700 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609703 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609706 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609709 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609713 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609716 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:27.809619 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609719 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609721 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609724 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609727 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609729 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609732 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609735 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609743 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609746 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609749 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609751 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609754 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609756 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609761 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609763 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609766 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609769 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609771 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609774 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609777 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:27.810394 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609779 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609782 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609784 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609787 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609789 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609793 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609797 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609799 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609802 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609804 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609808 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609811 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609814 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609816 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609819 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609821 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609824 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609827 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609829 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:27.811215 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609832 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609840 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609843 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609846 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609848 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609851 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609855 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609858 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609862 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609865 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609868 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609871 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609874 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609877 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609880 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609882 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609885 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609887 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609890 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:27.813279 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609892 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609895 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609898 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609900 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609904 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609907 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609909 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609912 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609915 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609917 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609920 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609922 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609925 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609927 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609930 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609939 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609941 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609944 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609946 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:27.814137 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:27.609950 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.609955 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.610130 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.612277 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.613438 2572 server.go:1019] "Starting client certificate rotation" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.613549 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.613583 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.617747 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.621218 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.629872 2572 log.go:25] "Validated CRI v1 runtime API" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.632302 2572 log.go:25] "Validated CRI v1 image API" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.633873 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 18:06:27.815820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.636659 2572 fs.go:135] Filesystem UUIDs: map[2b80e991-9004-4681-8075-cb21d75d7233:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c7785a70-7ee6-4763-90c2-6ee6ad890676:/dev/nvme0n1p3] Jul 23 18:06:27.816232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.636678 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.640958 2572 manager.go:216] Machine: {Timestamp:2026-07-23 18:06:27.640459786 +0000 UTC m=+0.259349761 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095146 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad2117c165976628778bdd0fc5b22 SystemUUID:ec2ad211-7c16-5976-6287-78bdd0fc5b22 BootID:555a7a74-b5a7-4778-bf37-adb518f87b62 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:3c:43:e3:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:3c:43:e3:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:3c:93:e6:0c:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.641078 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.641205 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.643738 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.643774 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.644398 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.644409 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 18:06:27.817524 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.644417 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.645012 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.646177 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.650363 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.650521 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651040 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651057 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651070 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651080 2572 kubelet.go:398] "Adding apiserver pod source" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651091 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651505 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.651528 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.653292 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.655195 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.655224 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656304 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656322 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656333 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656356 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656856 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656913 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656928 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656936 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656966 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656975 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.656998 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.657008 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.657625 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.657640 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.661247 2572 server.go:1268] "Started kubelet" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.661384 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.661356 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.661562 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.663410 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.663816 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.665217 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.665507 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.665911 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 18:06:27.817944 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.665914 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.665373 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-157.ec2.internal.18c4fd6ad7030076 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-157.ec2.internal,UID:ip-10-0-129-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-157.ec2.internal,},FirstTimestamp:2026-07-23 18:06:27.66121791 +0000 UTC m=+0.280107886,LastTimestamp:2026-07-23 18:06:27.66121791 +0000 UTC m=+0.280107886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-157.ec2.internal,}" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.668751 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.668766 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.668866 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.669234 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.669273 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.669296 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.669431 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.669442 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670470 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670485 2572 factory.go:55] Registering systemd factory Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670493 2572 factory.go:223] Registration of the systemd container factory successfully Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670697 2572 factory.go:153] Registering CRI-O factory Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670707 2572 factory.go:223] Registration of the crio container factory successfully Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670729 2572 factory.go:103] Registering Raw factory Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.670743 2572 manager.go:1196] Started watching for new ooms in manager Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.671290 2572 manager.go:349] Starting recovery of all containers Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.679405 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.685024 2572 manager.go:354] Recovery completed Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.691724 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.693650 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.693699 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.693713 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.694249 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.694261 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.694281 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.694295 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:27.820881 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.769796 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:27.927069 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.870136 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.055476 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.950027 2572 policy_none.go:49] "None policy: Start" Jul 23 18:06:28.055476 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.950050 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 18:06:28.055476 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.950065 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 18:06:28.055476 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:27.952354 2572 policy_none.go:47] "Start" Jul 23 18:06:28.055476 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:27.971264 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.073100 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.071696 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.187854 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.172645 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.295344 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.273168 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.298812 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.298476 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:28.298812 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.298516 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:28.298812 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.298530 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:28.306106 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.305284 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-157.ec2.internal.18c4fd6ad8f25a55 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-157.ec2.internal,UID:ip-10-0-129-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-157.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-157.ec2.internal,},FirstTimestamp:2026-07-23 18:06:27.693681237 +0000 UTC m=+0.312571220,LastTimestamp:2026-07-23 18:06:27.693681237 +0000 UTC m=+0.312571220,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-157.ec2.internal,}" Jul 23 18:06:28.313723 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.313282 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 18:06:28.313723 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.313305 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.316873 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-157.ec2.internal.18c4fd6ad8f2bba4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-157.ec2.internal,UID:ip-10-0-129-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-157.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-157.ec2.internal,},FirstTimestamp:2026-07-23 18:06:27.693706148 +0000 UTC m=+0.312596130,LastTimestamp:2026-07-23 18:06:27.693706148 +0000 UTC m=+0.312596130,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-157.ec2.internal,}" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.319811 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.323815 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-157.ec2.internal.18c4fd6ad8f2e5da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-157.ec2.internal,UID:ip-10-0-129-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-157.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-157.ec2.internal,},FirstTimestamp:2026-07-23 18:06:27.693716954 +0000 UTC m=+0.312606930,LastTimestamp:2026-07-23 18:06:27.693716954 +0000 UTC m=+0.312606930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-157.ec2.internal,}" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.329093 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-157.ec2.internal.18c4fd6ad8f25a55\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-157.ec2.internal.18c4fd6ad8f25a55 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-157.ec2.internal,UID:ip-10-0-129-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-157.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-157.ec2.internal,},FirstTimestamp:2026-07-23 18:06:27.693681237 +0000 UTC m=+0.312571220,LastTimestamp:2026-07-23 18:06:28.298497251 +0000 UTC m=+0.917387234,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-157.ec2.internal,}" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.332894 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9jhs" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334213 2572 manager.go:337] "Starting Device Plugin manager" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.334256 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334267 2572 server.go:87] "Starting device plugin registration server" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334594 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334609 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334706 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334806 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.334816 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 18:06:28.393424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.339040 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9jhs" Jul 23 18:06:28.394029 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.339783 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-157.ec2.internal.18c4fd6ad8f2bba4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-157.ec2.internal.18c4fd6ad8f2bba4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-157.ec2.internal,UID:ip-10-0-129-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-157.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-157.ec2.internal,},FirstTimestamp:2026-07-23 18:06:27.693706148 +0000 UTC m=+0.312596130,LastTimestamp:2026-07-23 18:06:28.298522548 +0000 UTC m=+0.917412531,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-157.ec2.internal,}" Jul 23 18:06:28.394029 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.377333 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 18:06:28.394029 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.377407 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.435649 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.436852 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.436883 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.436899 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.436932 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.445588 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.445616 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-157.ec2.internal\": node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.471159 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.460945 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.510257 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.510230 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 18:06:28.510372 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.510278 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 18:06:28.510372 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.510305 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 18:06:28.510372 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.510347 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 18:06:28.512744 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.512716 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:28.561538 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.561500 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.569729 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.569703 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:28.612673 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.612622 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal"] Jul 23 18:06:28.612735 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.612727 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:28.612771 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.612657 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 18:06:28.612914 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.612889 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:06:28.612964 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.612892 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:06:28.613847 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.613830 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:28.613951 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.613868 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:28.613951 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.613895 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:28.616489 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.616469 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:28.616607 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.616581 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.616648 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.616620 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:28.618922 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.618905 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:28.619007 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.618934 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:28.619007 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.618945 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:28.619007 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.618904 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:28.619100 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.619014 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:28.619100 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.619026 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:28.621475 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.621454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.621603 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.621491 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:28.622370 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.622347 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:28.622475 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.622386 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:28.622475 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.622417 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:28.638146 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.638113 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-157.ec2.internal\" not found" node="ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.642481 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.642456 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-157.ec2.internal\" not found" node="ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.661735 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.661696 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.675221 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.675181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f72d47411db597d9e8c9b9703e40acca-config\") pod \"kube-apiserver-proxy-ip-10-0-129-157.ec2.internal\" (UID: \"f72d47411db597d9e8c9b9703e40acca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.675221 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.675219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26204e8ce2c5336ffcfca077e22800ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal\" (UID: \"26204e8ce2c5336ffcfca077e22800ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.675788 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.675239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26204e8ce2c5336ffcfca077e22800ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal\" (UID: \"26204e8ce2c5336ffcfca077e22800ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.765017 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.764917 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.776226 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.776191 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f72d47411db597d9e8c9b9703e40acca-config\") pod \"kube-apiserver-proxy-ip-10-0-129-157.ec2.internal\" (UID: \"f72d47411db597d9e8c9b9703e40acca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.776391 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.776221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f72d47411db597d9e8c9b9703e40acca-config\") pod \"kube-apiserver-proxy-ip-10-0-129-157.ec2.internal\" (UID: \"f72d47411db597d9e8c9b9703e40acca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.776391 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.776277 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26204e8ce2c5336ffcfca077e22800ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal\" (UID: \"26204e8ce2c5336ffcfca077e22800ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.776391 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.776297 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26204e8ce2c5336ffcfca077e22800ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal\" (UID: \"26204e8ce2c5336ffcfca077e22800ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.776391 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.776337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26204e8ce2c5336ffcfca077e22800ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal\" (UID: \"26204e8ce2c5336ffcfca077e22800ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.776533 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.776397 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26204e8ce2c5336ffcfca077e22800ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal\" (UID: \"26204e8ce2c5336ffcfca077e22800ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.871643 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.871589 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:28.945650 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.945610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.945765 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:28.945656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:28.972064 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:28.972023 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:29.073597 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.073486 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:29.173749 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.173709 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-157.ec2.internal\" not found" Jul 23 18:06:29.264390 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.264340 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:29.264576 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.264493 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:29.269128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.269106 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" Jul 23 18:06:29.281990 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.281963 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:06:29.282923 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.282909 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" Jul 23 18:06:29.291313 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.291289 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:06:29.344800 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.344703 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:01:29 +0000 UTC" deadline="2028-02-14 21:09:15.922763402 +0000 UTC" Jul 23 18:06:29.344800 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.344742 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13707h2m46.578025008s" Jul 23 18:06:29.586869 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:29.586828 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26204e8ce2c5336ffcfca077e22800ff.slice/crio-af73735aa4d3906a096d480d928649abb173dc642260a2cf9e954fc54804c0a5 WatchSource:0}: Error finding container af73735aa4d3906a096d480d928649abb173dc642260a2cf9e954fc54804c0a5: Status 404 returned error can't find the container with id af73735aa4d3906a096d480d928649abb173dc642260a2cf9e954fc54804c0a5 Jul 23 18:06:29.587280 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:29.587256 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72d47411db597d9e8c9b9703e40acca.slice/crio-51dd3bc90084a3052ce195ba1c7584e2120ed3362bae524ce08aae89d5d8577d WatchSource:0}: Error finding container 51dd3bc90084a3052ce195ba1c7584e2120ed3362bae524ce08aae89d5d8577d: Status 404 returned error can't find the container with id 51dd3bc90084a3052ce195ba1c7584e2120ed3362bae524ce08aae89d5d8577d Jul 23 18:06:29.591886 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.591865 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:06:29.607187 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.607106 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:29.652356 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.652299 2572 apiserver.go:52] "Watching apiserver" Jul 23 18:06:29.662744 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.662716 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 18:06:29.663803 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.663774 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal","openshift-multus/multus-additional-cni-plugins-xwzxp","openshift-multus/multus-vgml4","openshift-network-diagnostics/network-check-target-hzpn6","openshift-ovn-kubernetes/ovnkube-node-mxrwf","kube-system/global-pull-secret-syncer-7d978","kube-system/konnectivity-agent-h6th7","kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal","openshift-dns/node-resolver-vtmfd","openshift-image-registry/node-ca-mw6z5","openshift-multus/network-metrics-daemon-z8dkb","openshift-network-operator/iptables-alerter-vqlbx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7","openshift-cluster-node-tuning-operator/tuned-psb7m"] Jul 23 18:06:29.667996 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.667961 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.670223 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.670199 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 18:06:29.670392 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.670377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.671174 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.671154 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8zbnz\"" Jul 23 18:06:29.671278 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.671200 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 18:06:29.671278 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.671261 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 18:06:29.672756 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.672731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.673074 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.672989 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z4jgn\"" Jul 23 18:06:29.673074 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.673021 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.673229 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.673098 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 18:06:29.673286 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.673243 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.675093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.675067 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:29.675199 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.675174 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:29.675707 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.675688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 18:06:29.676287 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.675743 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.676287 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.675755 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.676287 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.675777 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 18:06:29.676287 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.676048 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-chnk8\"" Jul 23 18:06:29.677727 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.677710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.680717 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.680531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.680717 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.680627 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:29.681120 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.681095 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.682350 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-socket-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.682350 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-socket-dir-parent\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-registration-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-kubelet\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682491 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-sys-fs\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgnt\" (UniqueName: \"kubernetes.io/projected/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-kube-api-access-5mgnt\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-system-cni-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-os-release\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.682620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-k8s-cni-cncf-io\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-cni-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682647 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-etc-kubernetes\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6fcb5a0-81a7-4ec9-ba65-b134756ac48e-agent-certs\") pod \"konnectivity-agent-h6th7\" (UID: \"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e\") " pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682731 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682712 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b464f\"" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682650 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682833 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682879 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-netns\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-cni-bin\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-hostroot\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6fcb5a0-81a7-4ec9-ba65-b134756ac48e-konnectivity-ca\") pod \"konnectivity-agent-h6th7\" (UID: \"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e\") " pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.682988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-conf-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683049 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ht8n\" (UniqueName: \"kubernetes.io/projected/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-kube-api-access-2ht8n\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-multus-certs\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-cni-binary-copy\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683147 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-daemon-config\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-device-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-cnibin\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.683872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.683329 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-cni-multus\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.686005 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.685943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.686232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.686207 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.686330 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.686251 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6b6s\"" Jul 23 18:06:29.686330 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.686211 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.688676 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.688653 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.689309 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.689292 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.689309 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.689302 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tf7r6\"" Jul 23 18:06:29.689522 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.689303 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.691174 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.691059 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.691650 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.691630 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 18:06:29.691650 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.691646 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 18:06:29.691861 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.691845 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xndfs\"" Jul 23 18:06:29.693513 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.693492 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 18:06:29.693671 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.693654 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:29.693733 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.693717 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:29.694087 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.694066 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.694251 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.694092 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.694251 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.694170 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vcvgv\"" Jul 23 18:06:29.696183 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.696142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.698441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.698409 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:06:29.699066 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.699048 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxzmz\"" Jul 23 18:06:29.699303 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.699290 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 18:06:29.699375 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.699333 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 18:06:29.711043 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.711019 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbnsl" Jul 23 18:06:29.719954 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.719931 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbnsl" Jul 23 18:06:29.770255 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.770226 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 18:06:29.784387 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6fcb5a0-81a7-4ec9-ba65-b134756ac48e-agent-certs\") pod \"konnectivity-agent-h6th7\" (UID: \"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e\") " pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.784504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.784504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.784504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-netns\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-cni-bin\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784470 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-hostroot\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzmwk\" (UniqueName: \"kubernetes.io/projected/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-kube-api-access-mzmwk\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784508 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784530 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50715535-157b-4b6e-83e9-2d80f722caec-iptables-alerter-script\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784548 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-cni-bin\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-conf-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784569 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-netns\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-systemd-units\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784624 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784658 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-conf-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784701 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-hostroot\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-cni-netd\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784746 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-daemon-config\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-tmp-dir\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.784797 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784799 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-tmp\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-device-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784885 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-cnibin\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-systemd\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-run\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-var-lib-kubelet\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784942 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-device-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.784977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50715535-157b-4b6e-83e9-2d80f722caec-host-slash\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-socket-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785034 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-kubelet\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785050 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-cnibin\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4k8g\" (UniqueName: \"kubernetes.io/projected/96009908-abbc-435e-b0f7-6171e463b280-kube-api-access-l4k8g\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-env-overrides\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.785458 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785234 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-kubelet\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785237 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysctl-conf\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjbl\" (UniqueName: \"kubernetes.io/projected/50715535-157b-4b6e-83e9-2d80f722caec-kube-api-access-hjjbl\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785305 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-sys-fs\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785347 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-sys-fs\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-os-release\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785468 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-os-release\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785484 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-socket-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-kubelet-config\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-dbus\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785553 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-daemon-config\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:29.786095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-cni-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785702 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-etc-kubernetes\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785799 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-etc-kubernetes\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-ovnkube-config\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysconfig\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785902 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-cni-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-systemd\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-host\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.785990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786016 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-ovnkube-script-lib\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786042 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4f8l\" (UniqueName: \"kubernetes.io/projected/9a073930-43c6-4ba1-8db2-557caa9e7641-kube-api-access-m4f8l\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6fcb5a0-81a7-4ec9-ba65-b134756ac48e-konnectivity-ca\") pod \"konnectivity-agent-h6th7\" (UID: \"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e\") " pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.786828 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ht8n\" (UniqueName: \"kubernetes.io/projected/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-kube-api-access-2ht8n\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-hosts-file\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-system-cni-dir\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-slash\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-run-netns\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-etc-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786245 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-ovn\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786264 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-log-socket\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-multus-certs\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-cni-binary-copy\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a073930-43c6-4ba1-8db2-557caa9e7641-ovn-node-metrics-cert\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-multus-certs\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-modprobe-d\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.787258 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-kubernetes\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-tuned\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-cni-multus\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjw4\" (UniqueName: \"kubernetes.io/projected/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-kube-api-access-5kjw4\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-cnibin\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786573 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-var-lib-cni-multus\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2dw\" (UniqueName: \"kubernetes.io/projected/c52668d7-cb37-4865-886e-de9262b6f8f0-kube-api-access-xn2dw\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-var-lib-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786627 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-socket-dir-parent\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysctl-d\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-registration-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-os-release\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786740 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-multus-socket-dir-parent\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.787743 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786761 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6fcb5a0-81a7-4ec9-ba65-b134756ac48e-konnectivity-ca\") pod \"konnectivity-agent-h6th7\" (UID: \"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e\") " pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a0e9307-d975-447c-9196-9f5b2e3131ac-host\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786818 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-registration-dir\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786835 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a0e9307-d975-447c-9196-9f5b2e3131ac-serviceca\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-kubelet\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-cni-bin\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgnt\" (UniqueName: \"kubernetes.io/projected/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-kube-api-access-5mgnt\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-system-cni-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.786969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-k8s-cni-cncf-io\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-node-log\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787004 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-cni-binary-copy\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnd5b\" (UniqueName: \"kubernetes.io/projected/8a0e9307-d975-447c-9196-9f5b2e3131ac-kube-api-access-pnd5b\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-host-run-k8s-cni-cncf-io\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.788146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-system-cni-dir\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.788643 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-sys\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.788643 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.787132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-lib-modules\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.788837 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.788819 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6fcb5a0-81a7-4ec9-ba65-b134756ac48e-agent-certs\") pod \"konnectivity-agent-h6th7\" (UID: \"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e\") " pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.798167 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.798136 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ht8n\" (UniqueName: \"kubernetes.io/projected/852c854e-8538-4df8-b9cc-1d7b0b1ef8ac-kube-api-access-2ht8n\") pod \"multus-vgml4\" (UID: \"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac\") " pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.798655 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.798629 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgnt\" (UniqueName: \"kubernetes.io/projected/ff7c18a2-218e-40dc-aec3-b0f3bf5ae433-kube-api-access-5mgnt\") pod \"aws-ebs-csi-driver-node-ntrk7\" (UID: \"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.888042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.887943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-systemd\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.888042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.887974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-run\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.888042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.887990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-var-lib-kubelet\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.888042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50715535-157b-4b6e-83e9-2d80f722caec-host-slash\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.888042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4k8g\" (UniqueName: \"kubernetes.io/projected/96009908-abbc-435e-b0f7-6171e463b280-kube-api-access-l4k8g\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-env-overrides\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888057 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-systemd\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysctl-conf\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888092 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-var-lib-kubelet\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888094 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50715535-157b-4b6e-83e9-2d80f722caec-host-slash\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888092 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-run\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjbl\" (UniqueName: \"kubernetes.io/projected/50715535-157b-4b6e-83e9-2d80f722caec-kube-api-access-hjjbl\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-kubelet-config\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888237 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysctl-conf\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888259 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-kubelet-config\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-dbus\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.888441 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888292 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888338 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-dbus\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-ovnkube-config\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysconfig\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888514 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-systemd\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-host\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888606 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-systemd\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-ovnkube-script-lib\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888649 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-host\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.889131 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888674 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4f8l\" (UniqueName: \"kubernetes.io/projected/9a073930-43c6-4ba1-8db2-557caa9e7641-kube-api-access-m4f8l\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888680 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-env-overrides\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-hosts-file\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.888703 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888749 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-hosts-file\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.888809 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:30.388759674 +0000 UTC m=+3.007649669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888796 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysconfig\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888828 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-system-cni-dir\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888880 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-system-cni-dir\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888902 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-slash\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-run-netns\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-etc-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.889811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.888972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-ovn\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-log-socket\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889013 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-ovn\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889011 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-run-netns\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a073930-43c6-4ba1-8db2-557caa9e7641-ovn-node-metrics-cert\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889050 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-slash\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889064 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-ovnkube-config\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889078 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-etc-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-log-socket\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-modprobe-d\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.889139 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-kubernetes\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.889185 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:30.389170488 +0000 UTC m=+3.008060456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:29.890433 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889194 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a073930-43c6-4ba1-8db2-557caa9e7641-ovnkube-script-lib\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-tuned\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889209 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-kubernetes\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjw4\" (UniqueName: \"kubernetes.io/projected/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-kube-api-access-5kjw4\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-modprobe-d\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-cnibin\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2dw\" (UniqueName: \"kubernetes.io/projected/c52668d7-cb37-4865-886e-de9262b6f8f0-kube-api-access-xn2dw\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-var-lib-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-cnibin\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysctl-d\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-var-lib-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-os-release\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.890879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a0e9307-d975-447c-9196-9f5b2e3131ac-host\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a0e9307-d975-447c-9196-9f5b2e3131ac-serviceca\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889519 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96009908-abbc-435e-b0f7-6171e463b280-os-release\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-kubelet\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-sysctl-d\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889573 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a0e9307-d975-447c-9196-9f5b2e3131ac-host\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-kubelet\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-cni-bin\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889635 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-node-log\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnd5b\" (UniqueName: \"kubernetes.io/projected/8a0e9307-d975-447c-9196-9f5b2e3131ac-kube-api-access-pnd5b\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-cni-bin\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-node-log\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-sys\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-lib-modules\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzmwk\" (UniqueName: \"kubernetes.io/projected/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-kube-api-access-mzmwk\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891305 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889834 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-sys\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889848 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50715535-157b-4b6e-83e9-2d80f722caec-iptables-alerter-script\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-systemd-units\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-cni-netd\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-lib-modules\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889989 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a0e9307-d975-447c-9196-9f5b2e3131ac-serviceca\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889997 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-systemd-units\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.889997 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-host-cni-netd\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.890015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-tmp-dir\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.890044 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-tmp\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.890055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96009908-abbc-435e-b0f7-6171e463b280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.890045 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a073930-43c6-4ba1-8db2-557caa9e7641-run-openvswitch\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.890298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-tmp-dir\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.891767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.890486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50715535-157b-4b6e-83e9-2d80f722caec-iptables-alerter-script\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.892264 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.892138 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-etc-tuned\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.892264 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.892151 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a073930-43c6-4ba1-8db2-557caa9e7641-ovn-node-metrics-cert\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.892431 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.892399 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-tmp\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.896892 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.896868 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:29.896892 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.896897 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:29.897106 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.896911 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:29.897106 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:29.897016 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:06:30.396995649 +0000 UTC m=+3.015885635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:29.899104 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.899059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjbl\" (UniqueName: \"kubernetes.io/projected/50715535-157b-4b6e-83e9-2d80f722caec-kube-api-access-hjjbl\") pod \"iptables-alerter-vqlbx\" (UID: \"50715535-157b-4b6e-83e9-2d80f722caec\") " pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:29.899583 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.899557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4k8g\" (UniqueName: \"kubernetes.io/projected/96009908-abbc-435e-b0f7-6171e463b280-kube-api-access-l4k8g\") pod \"multus-additional-cni-plugins-xwzxp\" (UID: \"96009908-abbc-435e-b0f7-6171e463b280\") " pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:29.900114 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.900086 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnd5b\" (UniqueName: \"kubernetes.io/projected/8a0e9307-d975-447c-9196-9f5b2e3131ac-kube-api-access-pnd5b\") pod \"node-ca-mw6z5\" (UID: \"8a0e9307-d975-447c-9196-9f5b2e3131ac\") " pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:29.900817 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.900788 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzmwk\" (UniqueName: \"kubernetes.io/projected/a110fc2c-16b6-4df0-b273-3b83bbfa68e8-kube-api-access-mzmwk\") pod \"tuned-psb7m\" (UID: \"a110fc2c-16b6-4df0-b273-3b83bbfa68e8\") " pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:29.900908 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.900848 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjw4\" (UniqueName: \"kubernetes.io/projected/05a8347e-f1f4-4635-bb0a-a3898f8ea9d6-kube-api-access-5kjw4\") pod \"node-resolver-vtmfd\" (UID: \"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6\") " pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:29.901185 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.901165 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4f8l\" (UniqueName: \"kubernetes.io/projected/9a073930-43c6-4ba1-8db2-557caa9e7641-kube-api-access-m4f8l\") pod \"ovnkube-node-mxrwf\" (UID: \"9a073930-43c6-4ba1-8db2-557caa9e7641\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:29.901185 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.901175 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2dw\" (UniqueName: \"kubernetes.io/projected/c52668d7-cb37-4865-886e-de9262b6f8f0-kube-api-access-xn2dw\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:29.980606 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.980555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:29.987587 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.987562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" Jul 23 18:06:29.991979 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:29.991944 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6fcb5a0_81a7_4ec9_ba65_b134756ac48e.slice/crio-f7f759f08627e1836c4ea059e2cf90c463cd604ab6b60374a5ad55056a298fa4 WatchSource:0}: Error finding container f7f759f08627e1836c4ea059e2cf90c463cd604ab6b60374a5ad55056a298fa4: Status 404 returned error can't find the container with id f7f759f08627e1836c4ea059e2cf90c463cd604ab6b60374a5ad55056a298fa4 Jul 23 18:06:29.996071 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:29.996045 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vgml4" Jul 23 18:06:29.996701 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:29.996678 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7c18a2_218e_40dc_aec3_b0f3bf5ae433.slice/crio-b0b95e819ca31d66b3c9837c5e40be4602b221103ef5d509d73f50c0efe168dd WatchSource:0}: Error finding container b0b95e819ca31d66b3c9837c5e40be4602b221103ef5d509d73f50c0efe168dd: Status 404 returned error can't find the container with id b0b95e819ca31d66b3c9837c5e40be4602b221103ef5d509d73f50c0efe168dd Jul 23 18:06:30.000117 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.000094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:30.007103 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.007068 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vtmfd" Jul 23 18:06:30.007535 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:30.007509 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852c854e_8538_4df8_b9cc_1d7b0b1ef8ac.slice/crio-7ae1fa3c585c57f4422630f34f03c235847114ddb9daea3e1bf1cf043be04c2d WatchSource:0}: Error finding container 7ae1fa3c585c57f4422630f34f03c235847114ddb9daea3e1bf1cf043be04c2d: Status 404 returned error can't find the container with id 7ae1fa3c585c57f4422630f34f03c235847114ddb9daea3e1bf1cf043be04c2d Jul 23 18:06:30.009720 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:30.009698 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a073930_43c6_4ba1_8db2_557caa9e7641.slice/crio-8c550f03177466a355c70e405e16449bf26623c0b848835b26c0f7acbc34d1cc WatchSource:0}: Error finding container 8c550f03177466a355c70e405e16449bf26623c0b848835b26c0f7acbc34d1cc: Status 404 returned error can't find the container with id 8c550f03177466a355c70e405e16449bf26623c0b848835b26c0f7acbc34d1cc Jul 23 18:06:30.013274 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.013252 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-psb7m" Jul 23 18:06:30.017195 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:30.017170 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a8347e_f1f4_4635_bb0a_a3898f8ea9d6.slice/crio-ce311888d54d8e0d0d8f86dccc27493c6126ade5aed3ff11d65b334805f25151 WatchSource:0}: Error finding container ce311888d54d8e0d0d8f86dccc27493c6126ade5aed3ff11d65b334805f25151: Status 404 returned error can't find the container with id ce311888d54d8e0d0d8f86dccc27493c6126ade5aed3ff11d65b334805f25151 Jul 23 18:06:30.019047 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.019030 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" Jul 23 18:06:30.023007 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:30.022973 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda110fc2c_16b6_4df0_b273_3b83bbfa68e8.slice/crio-3531e05357aaae1ddaf108c33535b2bcbc6f7e69bf0fe9e1f80161b99bc5442a WatchSource:0}: Error finding container 3531e05357aaae1ddaf108c33535b2bcbc6f7e69bf0fe9e1f80161b99bc5442a: Status 404 returned error can't find the container with id 3531e05357aaae1ddaf108c33535b2bcbc6f7e69bf0fe9e1f80161b99bc5442a Jul 23 18:06:30.025664 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.025573 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mw6z5" Jul 23 18:06:30.031786 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.031572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vqlbx" Jul 23 18:06:30.040261 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:30.040231 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0e9307_d975_447c_9196_9f5b2e3131ac.slice/crio-4434d526f22e26223623001f243d83b65113d99d642f0297484cd9213c9f2e4a WatchSource:0}: Error finding container 4434d526f22e26223623001f243d83b65113d99d642f0297484cd9213c9f2e4a: Status 404 returned error can't find the container with id 4434d526f22e26223623001f243d83b65113d99d642f0297484cd9213c9f2e4a Jul 23 18:06:30.042138 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:06:30.042109 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50715535_157b_4b6e_83e9_2d80f722caec.slice/crio-d7d1960d66005fbc8a703c57378079693e364075564417c299f003504e81b3fa WatchSource:0}: Error finding container d7d1960d66005fbc8a703c57378079693e364075564417c299f003504e81b3fa: Status 404 returned error can't find the container with id d7d1960d66005fbc8a703c57378079693e364075564417c299f003504e81b3fa Jul 23 18:06:30.393529 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.393475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:30.393709 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.393541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:30.393709 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.393675 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:30.393880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.393748 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:31.393725216 +0000 UTC m=+4.012615184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:30.393880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.393675 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:30.393880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.393804 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:31.393790039 +0000 UTC m=+4.012680003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:30.495135 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.494952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:30.495331 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.495198 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:30.495331 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.495220 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:30.495331 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.495236 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:30.495331 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:30.495310 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:06:31.495288898 +0000 UTC m=+4.114178867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:30.522018 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.521948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vqlbx" event={"ID":"50715535-157b-4b6e-83e9-2d80f722caec","Type":"ContainerStarted","Data":"d7d1960d66005fbc8a703c57378079693e364075564417c299f003504e81b3fa"} Jul 23 18:06:30.526373 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.526278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-psb7m" event={"ID":"a110fc2c-16b6-4df0-b273-3b83bbfa68e8","Type":"ContainerStarted","Data":"3531e05357aaae1ddaf108c33535b2bcbc6f7e69bf0fe9e1f80161b99bc5442a"} Jul 23 18:06:30.529483 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.529374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vgml4" event={"ID":"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac","Type":"ContainerStarted","Data":"7ae1fa3c585c57f4422630f34f03c235847114ddb9daea3e1bf1cf043be04c2d"} Jul 23 18:06:30.532274 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.532179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" event={"ID":"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433","Type":"ContainerStarted","Data":"b0b95e819ca31d66b3c9837c5e40be4602b221103ef5d509d73f50c0efe168dd"} Jul 23 18:06:30.535316 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.535241 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" event={"ID":"26204e8ce2c5336ffcfca077e22800ff","Type":"ContainerStarted","Data":"af73735aa4d3906a096d480d928649abb173dc642260a2cf9e954fc54804c0a5"} Jul 23 18:06:30.545265 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.545225 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mw6z5" event={"ID":"8a0e9307-d975-447c-9196-9f5b2e3131ac","Type":"ContainerStarted","Data":"4434d526f22e26223623001f243d83b65113d99d642f0297484cd9213c9f2e4a"} Jul 23 18:06:30.548915 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.548850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerStarted","Data":"87216766be83b2d137f70035a0c8b48198af5a8eb00e807e4a2b12ccc3c348de"} Jul 23 18:06:30.551311 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.551268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vtmfd" event={"ID":"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6","Type":"ContainerStarted","Data":"ce311888d54d8e0d0d8f86dccc27493c6126ade5aed3ff11d65b334805f25151"} Jul 23 18:06:30.556603 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.556367 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"8c550f03177466a355c70e405e16449bf26623c0b848835b26c0f7acbc34d1cc"} Jul 23 18:06:30.558740 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.558467 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6th7" event={"ID":"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e","Type":"ContainerStarted","Data":"f7f759f08627e1836c4ea059e2cf90c463cd604ab6b60374a5ad55056a298fa4"} Jul 23 18:06:30.560219 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.560186 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" event={"ID":"f72d47411db597d9e8c9b9703e40acca","Type":"ContainerStarted","Data":"51dd3bc90084a3052ce195ba1c7584e2120ed3362bae524ce08aae89d5d8577d"} Jul 23 18:06:30.723942 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.723818 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:01:30 +0000 UTC" deadline="2028-04-15 04:28:58.669716768 +0000 UTC" Jul 23 18:06:30.723942 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:30.723887 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15154h22m27.945833145s" Jul 23 18:06:31.408438 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.404130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:31.408438 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.404188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:31.408438 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.404341 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:31.408438 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.404423 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:33.40438757 +0000 UTC m=+6.023277538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:31.408438 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.404869 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:31.408438 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.404927 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:33.404910028 +0000 UTC m=+6.023799997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:31.505124 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.505075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:31.505329 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.505313 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:31.505406 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.505337 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:31.505406 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.505349 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:31.505544 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.505434 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:06:33.505400631 +0000 UTC m=+6.124290598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:31.511297 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.511262 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:31.511507 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.511446 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:31.511582 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.511535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:31.511692 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.511667 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:31.511754 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.511545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:31.511812 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:31.511781 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:31.619521 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.619486 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:31.725093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.724966 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:01:30 +0000 UTC" deadline="2028-04-14 20:17:08.987676958 +0000 UTC" Jul 23 18:06:31.725093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:31.725012 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15146h10m37.262670323s" Jul 23 18:06:33.425874 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:33.424933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:33.425874 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:33.424997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:33.425874 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.425127 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:33.425874 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.425190 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:37.425171883 +0000 UTC m=+10.044061851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:33.425874 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.425764 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:33.425874 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.425831 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:37.425812021 +0000 UTC m=+10.044701988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:33.510800 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:33.510766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:33.511099 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.510917 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:33.511099 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:33.510981 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:33.511099 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.511050 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:33.511099 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:33.511092 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:33.511394 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.511159 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:33.526315 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:33.526278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:33.526539 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.526462 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:33.526539 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.526486 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:33.526539 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.526500 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:33.526771 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:33.526555 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:06:37.52653727 +0000 UTC m=+10.145427250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:35.511526 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:35.511484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:35.512118 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:35.511611 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:35.512118 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:35.511746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:35.512118 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:35.511852 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:35.512118 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:35.511744 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:35.512118 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:35.511944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:37.465059 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:37.464901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:37.465059 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:37.464976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:37.465672 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.465108 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:37.465672 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.465112 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:37.465672 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.465186 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:45.465162359 +0000 UTC m=+18.084052324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:37.465672 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.465211 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:45.465198434 +0000 UTC m=+18.084088398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:37.511576 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:37.511533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:37.511801 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:37.511551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:37.511801 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:37.511551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:37.511801 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.511705 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:37.511801 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.511768 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:37.512035 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.511873 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:37.565367 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:37.565323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:37.565602 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.565583 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:37.565683 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.565609 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:37.565683 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.565620 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:37.565795 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:37.565700 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:06:45.565685785 +0000 UTC m=+18.184575749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:39.510611 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:39.510575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:39.510611 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:39.510606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:39.511128 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:39.510691 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:39.511128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:39.510594 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:39.511128 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:39.510827 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:39.511128 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:39.510918 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:41.511127 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:41.511085 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:41.511127 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:41.511125 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:41.511645 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:41.511126 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:41.511645 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:41.511203 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:41.511645 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:41.511322 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:41.511645 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:41.511464 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:43.510827 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:43.510617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:43.511309 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:43.510617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:43.511309 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:43.510928 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:43.511309 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:43.510692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:43.511309 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:43.511026 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:43.511309 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:43.511061 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:45.511108 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:45.511070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:45.511585 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:45.511070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:45.511585 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.511206 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:45.511585 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:45.511069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:45.511585 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.511301 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:45.511585 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.511372 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:45.527493 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:45.527464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:45.527679 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:45.527504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:45.527679 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.527631 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:45.527763 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.527688 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:01.527671298 +0000 UTC m=+34.146561264 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:45.527763 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.527630 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:45.527849 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.527790 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:01.527770728 +0000 UTC m=+34.146660691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:45.628477 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:45.628424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:45.628630 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.628582 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:45.628630 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.628602 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:45.628630 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.628613 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:45.628745 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:45.628666 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:07:01.628652113 +0000 UTC m=+34.247542075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:47.510905 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:47.510874 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:47.511450 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:47.510873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:47.511450 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:47.510980 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:47.511450 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:47.510874 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:47.511450 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:47.511055 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:47.511450 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:47.511188 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:49.511486 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:49.511448 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:49.511486 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:49.511485 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:49.511988 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:49.511570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:49.511988 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:49.511585 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:49.511988 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:49.511686 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:49.511988 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:49.511774 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:51.510695 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.510522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:51.511146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.510527 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:51.511146 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:51.510795 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:51.511146 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.510588 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:51.511146 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:51.510893 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:51.511146 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:51.510926 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:51.634080 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634053 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:06:51.634515 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634490 2572 generic.go:356] "Generic (PLEG): container finished" podID="9a073930-43c6-4ba1-8db2-557caa9e7641" containerID="c9cc85dc29469376ef56995677310f87e879161182922f8316cb7ad70c7217b8" exitCode=1 Jul 23 18:06:51.634587 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634558 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"1e59a0ebced42e30c50d3faf12d8de5ca742b4187145c7bdbbaa1f2d98331d95"} Jul 23 18:06:51.634669 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"d0abbb9225aa4d2d35ad03cb7d6bfb993870a899e0229c102f72ccec74329617"} Jul 23 18:06:51.634722 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634709 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"35aa90329b38c53d1ec0b48672794dafa5d0c2f6192eb48daa762a09f6fe54fc"} Jul 23 18:06:51.634780 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerDied","Data":"c9cc85dc29469376ef56995677310f87e879161182922f8316cb7ad70c7217b8"} Jul 23 18:06:51.634833 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.634807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"c64c1b88f7f0e8fd3d81f91184bb6fa7eb508e0f1d15fe6f35eaac808cd2a1c4"} Jul 23 18:06:51.636155 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.636132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" event={"ID":"f72d47411db597d9e8c9b9703e40acca","Type":"ContainerStarted","Data":"cd34dd9c305352a5c901228eb4b365f2b85bf66c7cd2cc7b168900cce7c872b3"} Jul 23 18:06:51.637812 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.637783 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-psb7m" event={"ID":"a110fc2c-16b6-4df0-b273-3b83bbfa68e8","Type":"ContainerStarted","Data":"2bdac637d9993ae5e7c6eaebb3d2e5ae2055f85ca47ac89c3edb58de03d608fc"} Jul 23 18:06:51.640662 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.640634 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vgml4" event={"ID":"852c854e-8538-4df8-b9cc-1d7b0b1ef8ac","Type":"ContainerStarted","Data":"8bc50f3f48ebe718f51314cfc7e03b0c3f79cb3493f3af1f5647ad26ae01eebb"} Jul 23 18:06:51.651237 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.651180 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-157.ec2.internal" podStartSLOduration=21.651162011 podStartE2EDuration="21.651162011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:51.650389164 +0000 UTC m=+24.269279149" watchObservedRunningTime="2026-07-23 18:06:51.651162011 +0000 UTC m=+24.270052000" Jul 23 18:06:51.669464 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.669103 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vgml4" podStartSLOduration=1.702033489 podStartE2EDuration="22.669080273s" totalImagesPullingTime="20.967046784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:51.667953784 +0000 UTC m=+24.286843766" watchObservedRunningTime="2026-07-23 18:06:51.669080273 +0000 UTC m=+24.287970259" Jul 23 18:06:51.686850 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:51.686785 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-psb7m" podStartSLOduration=1.770520663 podStartE2EDuration="22.686763795s" totalImagesPullingTime="20.916243132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:51.68623871 +0000 UTC m=+24.305128697" watchObservedRunningTime="2026-07-23 18:06:51.686763795 +0000 UTC m=+24.305653781" Jul 23 18:06:52.644154 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.643905 2572 generic.go:356] "Generic (PLEG): container finished" podID="96009908-abbc-435e-b0f7-6171e463b280" containerID="6b0f4c67e5bcdee67595ad1b9c12cb39328687f778c08cdb22eb62a8698560ec" exitCode=0 Jul 23 18:06:52.644731 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.643980 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerDied","Data":"6b0f4c67e5bcdee67595ad1b9c12cb39328687f778c08cdb22eb62a8698560ec"} Jul 23 18:06:52.645804 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.645777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vtmfd" event={"ID":"05a8347e-f1f4-4635-bb0a-a3898f8ea9d6","Type":"ContainerStarted","Data":"0ad45859edeceb529b54c7eb46113456ee1f3a6b52d80c6dd5999aaeb7edb2ca"} Jul 23 18:06:52.648618 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.648600 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:06:52.649019 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.648987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"d1046813883c904d24aecaeac95875e12bd18eeffb2ee5eaf0d6fa516b04b6e9"} Jul 23 18:06:52.650369 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.650322 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6th7" event={"ID":"d6fcb5a0-81a7-4ec9-ba65-b134756ac48e","Type":"ContainerStarted","Data":"96f06568648d37695c081ff631a30496dae77a8c8ca690db3c1fda704d36d7d3"} Jul 23 18:06:52.651759 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.651735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vqlbx" event={"ID":"50715535-157b-4b6e-83e9-2d80f722caec","Type":"ContainerStarted","Data":"a9ffcbaa6b16ec372029083f6dd1e8c562a5446480b497571f911cac05c53989"} Jul 23 18:06:52.653064 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.653047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" event={"ID":"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433","Type":"ContainerStarted","Data":"4a4dcd3088f174f71a6e64f38c7b7878988d6467c1af06e160cccb5bd77224e7"} Jul 23 18:06:52.654413 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.654393 2572 generic.go:356] "Generic (PLEG): container finished" podID="26204e8ce2c5336ffcfca077e22800ff" containerID="b8a26efa73244464043ed2e1826814da809eda55acc64664c5e9fee82458fd42" exitCode=0 Jul 23 18:06:52.654508 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.654452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" event={"ID":"26204e8ce2c5336ffcfca077e22800ff","Type":"ContainerDied","Data":"b8a26efa73244464043ed2e1826814da809eda55acc64664c5e9fee82458fd42"} Jul 23 18:06:52.655838 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.655819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mw6z5" event={"ID":"8a0e9307-d975-447c-9196-9f5b2e3131ac","Type":"ContainerStarted","Data":"57a30dade6a582f73283a2a251e93e5bb873af08921c1948eee5617dc87884d6"} Jul 23 18:06:52.696814 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.696761 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vtmfd" podStartSLOduration=2.787095458 podStartE2EDuration="23.696738365s" totalImagesPullingTime="20.909642907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.696583052 +0000 UTC m=+25.315473037" watchObservedRunningTime="2026-07-23 18:06:52.696738365 +0000 UTC m=+25.315628350" Jul 23 18:06:52.713897 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.713856 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vqlbx" podStartSLOduration=2.830395296 podStartE2EDuration="23.713842234s" totalImagesPullingTime="20.883446938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.713426777 +0000 UTC m=+25.332316761" watchObservedRunningTime="2026-07-23 18:06:52.713842234 +0000 UTC m=+25.332732219" Jul 23 18:06:52.727140 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.727093 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h6th7" podStartSLOduration=2.7882944849999998 podStartE2EDuration="23.727080139s" totalImagesPullingTime="20.938785654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.726928794 +0000 UTC m=+25.345818779" watchObservedRunningTime="2026-07-23 18:06:52.727080139 +0000 UTC m=+25.345970123" Jul 23 18:06:52.741651 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:52.741587 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mw6z5" podStartSLOduration=2.851098073 podStartE2EDuration="23.741567715s" totalImagesPullingTime="20.890469642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.74141428 +0000 UTC m=+25.360304267" watchObservedRunningTime="2026-07-23 18:06:52.741567715 +0000 UTC m=+25.360457703" Jul 23 18:06:53.438468 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.438429 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 18:06:53.511218 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.511183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:53.511502 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.511183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:53.511502 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:53.511295 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:53.511502 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.511183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:53.511502 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:53.511402 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:53.511502 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:53.511474 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:53.660845 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.660757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" event={"ID":"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433","Type":"ContainerStarted","Data":"28d34783b1a437eaaa6c856d05c23e1435478ae948425b9b60989b4aefa91403"} Jul 23 18:06:53.662672 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.662635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" event={"ID":"26204e8ce2c5336ffcfca077e22800ff","Type":"ContainerStarted","Data":"91e4bc76029e1debe54252ea6fcf8223f133120c434ae7e4215c4710aa12fc5e"} Jul 23 18:06:53.678958 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:53.678907 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-157.ec2.internal" podStartSLOduration=23.678890336 podStartE2EDuration="23.678890336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:53.678487643 +0000 UTC m=+26.297377629" watchObservedRunningTime="2026-07-23 18:06:53.678890336 +0000 UTC m=+26.297780322" Jul 23 18:06:54.347513 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:54.347408 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:06:53.438462623Z","UUID":"bbbc18fe-d8f6-489a-afe4-581561580764","Handler":null,"Name":"","Endpoint":""} Jul 23 18:06:54.348873 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:54.348851 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 18:06:54.348997 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:54.348891 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 18:06:54.668157 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:54.668071 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:06:54.668967 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:54.668922 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"bf0329e988e58763c5d0170317879451ce93c75f1321b330414849d8ad156382"} Jul 23 18:06:55.510981 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:55.510943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:55.511179 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:55.511048 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:55.511179 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:55.511053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:55.511179 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:55.511153 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:55.511323 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:55.511222 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:55.511323 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:55.511050 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:55.674128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:55.674087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" event={"ID":"ff7c18a2-218e-40dc-aec3-b0f3bf5ae433","Type":"ContainerStarted","Data":"e338a7a7e0a4d0253216d0d9c5d847e6a98064c70ad7a13d9178e58e9723472a"} Jul 23 18:06:55.693742 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:55.693682 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntrk7" podStartSLOduration=3.388870382 podStartE2EDuration="26.693664516s" totalImagesPullingTime="23.304794134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:55.69320176 +0000 UTC m=+28.312091746" watchObservedRunningTime="2026-07-23 18:06:55.693664516 +0000 UTC m=+28.312554514" Jul 23 18:06:56.681404 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:56.681139 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:06:56.682134 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:56.681836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"3ce6b0e8bafedf6bc1d7a13f2dba5c4e5e1e73bf671decc7651bbc245b22b6d2"} Jul 23 18:06:56.682463 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:56.682443 2572 scope.go:117] "RemoveContainer" containerID="c9cc85dc29469376ef56995677310f87e879161182922f8316cb7ad70c7217b8" Jul 23 18:06:56.805830 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:56.805792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:56.806509 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:56.806483 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:57.510710 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:57.510619 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:57.510710 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:57.510651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:57.510710 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:57.510659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:57.510985 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:57.510755 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:57.510985 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:57.510844 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:57.510985 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:57.510938 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:57.684699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:57.684664 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:57.685313 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:57.685297 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h6th7" Jul 23 18:06:58.249567 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.249379 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7d978"] Jul 23 18:06:58.249772 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.249634 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:06:58.249772 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:58.249717 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:06:58.251593 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.251568 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8dkb"] Jul 23 18:06:58.251714 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.251655 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:06:58.251814 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:58.251738 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:06:58.261527 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.261439 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzpn6"] Jul 23 18:06:58.261527 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.261524 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:06:58.261693 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:06:58.261613 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:06:58.688555 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.688516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerStarted","Data":"ba96cc9461b739463d4d9535e2e7d7162d93aa5d05449342df9d1ff349ae9f4e"} Jul 23 18:06:58.692383 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.692360 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:06:58.692757 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.692737 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" event={"ID":"9a073930-43c6-4ba1-8db2-557caa9e7641","Type":"ContainerStarted","Data":"27e3960c8fef6da88156306959495f1dded1ae9fef2a3b9e809ef61e4b540672"} Jul 23 18:06:58.692848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.692829 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:58.692908 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.692901 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:58.692962 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.692950 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:58.708623 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.708600 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:58.708744 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.708697 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:06:58.739075 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:58.739022 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" podStartSLOduration=8.750650843 podStartE2EDuration="29.739003875s" totalImagesPullingTime="20.988353032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:58.738970371 +0000 UTC m=+31.357860356" watchObservedRunningTime="2026-07-23 18:06:58.739003875 +0000 UTC m=+31.357893860" Jul 23 18:06:59.696461 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:59.696428 2572 generic.go:356] "Generic (PLEG): container finished" podID="96009908-abbc-435e-b0f7-6171e463b280" containerID="ba96cc9461b739463d4d9535e2e7d7162d93aa5d05449342df9d1ff349ae9f4e" exitCode=0 Jul 23 18:06:59.696950 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:06:59.696501 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerDied","Data":"ba96cc9461b739463d4d9535e2e7d7162d93aa5d05449342df9d1ff349ae9f4e"} Jul 23 18:07:00.510563 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:00.510526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:00.510761 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:00.510570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:07:00.510761 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:00.510570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:00.510761 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:00.510657 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:07:00.510761 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:00.510745 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:07:00.510911 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:00.510826 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:07:00.713713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:00.713656 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" podUID="9a073930-43c6-4ba1-8db2-557caa9e7641" containerName="ovnkube-controller" probeResult="failure" output="" Jul 23 18:07:01.549712 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:01.549664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:07:01.549712 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:01.549706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:01.549979 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.549853 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:07:01.549979 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.549872 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:07:01.549979 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.549937 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:33.549916895 +0000 UTC m=+66.168806860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:07:01.549979 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.549960 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret podName:1737c532-e69c-4f3c-8cc7-7b8c0b6d1167 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:33.549950098 +0000 UTC m=+66.168840061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret") pod "global-pull-secret-syncer-7d978" (UID: "1737c532-e69c-4f3c-8cc7-7b8c0b6d1167") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:07:01.650718 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:01.650677 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:01.650886 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.650819 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:07:01.650886 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.650834 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:07:01.650886 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.650842 2572 projected.go:196] Error preparing data for projected volume kube-api-access-f987c for pod openshift-network-diagnostics/network-check-target-hzpn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:07:01.651063 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:01.650895 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c podName:56d1d355-b521-42c8-a6d2-413d5b212dbd nodeName:}" failed. No retries permitted until 2026-07-23 18:07:33.650877891 +0000 UTC m=+66.269767855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f987c" (UniqueName: "kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c") pod "network-check-target-hzpn6" (UID: "56d1d355-b521-42c8-a6d2-413d5b212dbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:07:01.702888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:01.702854 2572 generic.go:356] "Generic (PLEG): container finished" podID="96009908-abbc-435e-b0f7-6171e463b280" containerID="d769778177e6e3a84fcb2641adbb52f4b397c281ec008b2c02eeff01c7c0d2dc" exitCode=0 Jul 23 18:07:01.703051 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:01.702914 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerDied","Data":"d769778177e6e3a84fcb2641adbb52f4b397c281ec008b2c02eeff01c7c0d2dc"} Jul 23 18:07:02.510623 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:02.510591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:02.510623 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:02.510612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:02.510623 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:02.510589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:07:02.511162 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:02.510720 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:07:02.511162 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:02.510784 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:07:02.511162 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:02.510877 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:07:03.711001 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:03.710748 2572 generic.go:356] "Generic (PLEG): container finished" podID="96009908-abbc-435e-b0f7-6171e463b280" containerID="a56b25b2242d9afa25357d1582087c1696715771a757a1078b1ebdb3db760dc9" exitCode=0 Jul 23 18:07:03.711001 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:03.710833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerDied","Data":"a56b25b2242d9afa25357d1582087c1696715771a757a1078b1ebdb3db760dc9"} Jul 23 18:07:04.511673 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:04.511627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:07:04.511673 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:04.511674 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:04.511897 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:04.511756 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:07:04.511897 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:04.511627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:04.511991 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:04.511901 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzpn6" podUID="56d1d355-b521-42c8-a6d2-413d5b212dbd" Jul 23 18:07:04.511991 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:04.511957 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7d978" podUID="1737c532-e69c-4f3c-8cc7-7b8c0b6d1167" Jul 23 18:07:05.253859 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.253824 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-157.ec2.internal" event="NodeReady" Jul 23 18:07:05.254310 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.253972 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 18:07:05.297095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.297064 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j6kj4"] Jul 23 18:07:05.300272 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.300240 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8vmgn"] Jul 23 18:07:05.300457 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.300371 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.303099 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.303070 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 18:07:05.303298 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.303100 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 18:07:05.303298 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.303076 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6k4rc\"" Jul 23 18:07:05.303298 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.303225 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.305544 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.305499 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 18:07:05.305673 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.305571 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 18:07:05.305856 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.305828 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 18:07:05.305967 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.305885 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ktbk2\"" Jul 23 18:07:05.311511 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.311480 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j6kj4"] Jul 23 18:07:05.314098 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.314068 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8vmgn"] Jul 23 18:07:05.475858 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.475827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.476012 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.475948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932af207-0c99-4fa7-b8ac-106141a1f364-tmp-dir\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.476012 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.475973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d32bf6fa-e4a0-480a-803d-c2da79c18e17-cert\") pod \"ingress-canary-8vmgn\" (UID: \"d32bf6fa-e4a0-480a-803d-c2da79c18e17\") " pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.476012 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.476003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/932af207-0c99-4fa7-b8ac-106141a1f364-config-volume\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.476173 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.476071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqj2\" (UniqueName: \"kubernetes.io/projected/d32bf6fa-e4a0-480a-803d-c2da79c18e17-kube-api-access-szqj2\") pod \"ingress-canary-8vmgn\" (UID: \"d32bf6fa-e4a0-480a-803d-c2da79c18e17\") " pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.476173 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.476105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfkk\" (UniqueName: \"kubernetes.io/projected/932af207-0c99-4fa7-b8ac-106141a1f364-kube-api-access-lrfkk\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.577289 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577254 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/932af207-0c99-4fa7-b8ac-106141a1f364-config-volume\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.577289 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577300 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqj2\" (UniqueName: \"kubernetes.io/projected/d32bf6fa-e4a0-480a-803d-c2da79c18e17-kube-api-access-szqj2\") pod \"ingress-canary-8vmgn\" (UID: \"d32bf6fa-e4a0-480a-803d-c2da79c18e17\") " pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.577552 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577326 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfkk\" (UniqueName: \"kubernetes.io/projected/932af207-0c99-4fa7-b8ac-106141a1f364-kube-api-access-lrfkk\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.577552 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.577552 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:05.577462 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:05.577552 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:05.577527 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:06.077510315 +0000 UTC m=+38.696400279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:05.577753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932af207-0c99-4fa7-b8ac-106141a1f364-tmp-dir\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.577753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d32bf6fa-e4a0-480a-803d-c2da79c18e17-cert\") pod \"ingress-canary-8vmgn\" (UID: \"d32bf6fa-e4a0-480a-803d-c2da79c18e17\") " pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.577990 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/932af207-0c99-4fa7-b8ac-106141a1f364-config-volume\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.578048 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.577999 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932af207-0c99-4fa7-b8ac-106141a1f364-tmp-dir\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.582647 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.582620 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d32bf6fa-e4a0-480a-803d-c2da79c18e17-cert\") pod \"ingress-canary-8vmgn\" (UID: \"d32bf6fa-e4a0-480a-803d-c2da79c18e17\") " pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.586671 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.586643 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfkk\" (UniqueName: \"kubernetes.io/projected/932af207-0c99-4fa7-b8ac-106141a1f364-kube-api-access-lrfkk\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:05.586872 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.586750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqj2\" (UniqueName: \"kubernetes.io/projected/d32bf6fa-e4a0-480a-803d-c2da79c18e17-kube-api-access-szqj2\") pod \"ingress-canary-8vmgn\" (UID: \"d32bf6fa-e4a0-480a-803d-c2da79c18e17\") " pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.621841 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.621810 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8vmgn" Jul 23 18:07:05.776624 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:05.776593 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8vmgn"] Jul 23 18:07:05.782210 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:07:05.782175 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32bf6fa_e4a0_480a_803d_c2da79c18e17.slice/crio-7244577e90cdd035b5092217c46869c2897e43dcbd5a4a910973d77c4c0322e7 WatchSource:0}: Error finding container 7244577e90cdd035b5092217c46869c2897e43dcbd5a4a910973d77c4c0322e7: Status 404 returned error can't find the container with id 7244577e90cdd035b5092217c46869c2897e43dcbd5a4a910973d77c4c0322e7 Jul 23 18:07:06.082316 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.082281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:06.082505 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:06.082459 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:06.082564 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:06.082547 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:07.082521666 +0000 UTC m=+39.701411632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:06.511290 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.511209 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:06.512155 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.512134 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:07:06.512392 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.512367 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:06.517503 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.514992 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:07:06.517503 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.515043 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:07:06.517503 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.515899 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:07:06.517503 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.516324 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqn6\"" Jul 23 18:07:06.517503 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.516331 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hffp8\"" Jul 23 18:07:06.519061 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.518030 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:07:06.720757 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:06.720722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8vmgn" event={"ID":"d32bf6fa-e4a0-480a-803d-c2da79c18e17","Type":"ContainerStarted","Data":"7244577e90cdd035b5092217c46869c2897e43dcbd5a4a910973d77c4c0322e7"} Jul 23 18:07:07.090984 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:07.090629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:07.090984 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:07.090898 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:07.090984 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:07.090975 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.090952651 +0000 UTC m=+41.709842638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:09.108541 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:09.108503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:09.108953 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:09.108659 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:09.108953 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:09.108726 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:13.108709976 +0000 UTC m=+45.727599939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:09.728566 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:09.728471 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8vmgn" event={"ID":"d32bf6fa-e4a0-480a-803d-c2da79c18e17","Type":"ContainerStarted","Data":"6efb44d00ae64a7034d621a5881e40007c93c39e3859b35d79d1e36c1175effa"} Jul 23 18:07:09.731092 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:09.731061 2572 generic.go:356] "Generic (PLEG): container finished" podID="96009908-abbc-435e-b0f7-6171e463b280" containerID="d2fade343f847dc9c3615b91dfae9e55f3c7ab504655dff44457a033e9b14889" exitCode=0 Jul 23 18:07:09.731215 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:09.731120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerDied","Data":"d2fade343f847dc9c3615b91dfae9e55f3c7ab504655dff44457a033e9b14889"} Jul 23 18:07:09.745216 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:09.745163 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8vmgn" podStartSLOduration=1.402097081 podStartE2EDuration="4.745144307s" totalImagesPullingTime="3.343047226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:09.744809057 +0000 UTC m=+42.363699042" watchObservedRunningTime="2026-07-23 18:07:09.745144307 +0000 UTC m=+42.364034291" Jul 23 18:07:10.736664 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:10.736627 2572 generic.go:356] "Generic (PLEG): container finished" podID="96009908-abbc-435e-b0f7-6171e463b280" containerID="4534338f71fc6624ced56369dd618d6f61102bf7ef625d650a10d0320090b7cb" exitCode=0 Jul 23 18:07:10.737017 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:10.736698 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerDied","Data":"4534338f71fc6624ced56369dd618d6f61102bf7ef625d650a10d0320090b7cb"} Jul 23 18:07:11.742315 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:11.742282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" event={"ID":"96009908-abbc-435e-b0f7-6171e463b280","Type":"ContainerStarted","Data":"f5a48fd80a2b43c4be96a91b24702d7791e28749363d09217513a6891a511620"} Jul 23 18:07:11.764644 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:11.764593 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xwzxp" podStartSLOduration=7.981243741 podStartE2EDuration="42.764576355s" totalImagesPullingTime="34.783332614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:11.763213573 +0000 UTC m=+44.382103559" watchObservedRunningTime="2026-07-23 18:07:11.764576355 +0000 UTC m=+44.383466340" Jul 23 18:07:13.137223 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:13.137184 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:13.137605 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:13.137308 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:13.137605 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:13.137384 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.137368124 +0000 UTC m=+53.756258088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:21.190549 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:21.190506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:21.191064 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:21.190665 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:21.191064 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:21.190732 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.190714502 +0000 UTC m=+69.809604468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:30.709003 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:30.708967 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxrwf" Jul 23 18:07:33.573650 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.573597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:07:33.573650 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.573656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:33.576569 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.576550 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:07:33.576670 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.576653 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:07:33.584614 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:33.584588 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 18:07:33.584708 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:33.584694 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:08:37.584672734 +0000 UTC m=+130.203562704 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : secret "metrics-daemon-secret" not found Jul 23 18:07:33.587658 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.587641 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1737c532-e69c-4f3c-8cc7-7b8c0b6d1167-original-pull-secret\") pod \"global-pull-secret-syncer-7d978\" (UID: \"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167\") " pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:33.674905 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.674861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:33.677860 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.677840 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:07:33.687915 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.687886 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:07:33.698500 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.698476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f987c\" (UniqueName: \"kubernetes.io/projected/56d1d355-b521-42c8-a6d2-413d5b212dbd-kube-api-access-f987c\") pod \"network-check-target-hzpn6\" (UID: \"56d1d355-b521-42c8-a6d2-413d5b212dbd\") " pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:33.830420 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.830294 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hffp8\"" Jul 23 18:07:33.837799 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.837777 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:33.843358 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.843321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7d978" Jul 23 18:07:33.970175 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.970139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzpn6"] Jul 23 18:07:33.974702 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:07:33.974676 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d1d355_b521_42c8_a6d2_413d5b212dbd.slice/crio-1f58019cfb09b7fee662aec53065f825a1a01ef6ee129177815906c6251fedbf WatchSource:0}: Error finding container 1f58019cfb09b7fee662aec53065f825a1a01ef6ee129177815906c6251fedbf: Status 404 returned error can't find the container with id 1f58019cfb09b7fee662aec53065f825a1a01ef6ee129177815906c6251fedbf Jul 23 18:07:33.982562 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:33.982533 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7d978"] Jul 23 18:07:33.985746 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:07:33.985723 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1737c532_e69c_4f3c_8cc7_7b8c0b6d1167.slice/crio-404f419e3ae92cb8fec7e0a3b5780a1cedcc903c252a737aa2a124b54089b85c WatchSource:0}: Error finding container 404f419e3ae92cb8fec7e0a3b5780a1cedcc903c252a737aa2a124b54089b85c: Status 404 returned error can't find the container with id 404f419e3ae92cb8fec7e0a3b5780a1cedcc903c252a737aa2a124b54089b85c Jul 23 18:07:34.799038 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:34.798998 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzpn6" event={"ID":"56d1d355-b521-42c8-a6d2-413d5b212dbd","Type":"ContainerStarted","Data":"1f58019cfb09b7fee662aec53065f825a1a01ef6ee129177815906c6251fedbf"} Jul 23 18:07:34.800204 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:34.800176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7d978" event={"ID":"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167","Type":"ContainerStarted","Data":"404f419e3ae92cb8fec7e0a3b5780a1cedcc903c252a737aa2a124b54089b85c"} Jul 23 18:07:37.204188 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:37.202232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:07:37.204188 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:37.202755 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:37.204188 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:07:37.202831 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:08:09.202812765 +0000 UTC m=+101.821702730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:07:39.815252 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:39.815220 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzpn6" event={"ID":"56d1d355-b521-42c8-a6d2-413d5b212dbd","Type":"ContainerStarted","Data":"db4d8676b244d7b719bdf05d756ce585b92cfb61ed7d5a582ee67baa75f47c00"} Jul 23 18:07:39.815711 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:39.815305 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:07:39.816684 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:39.816659 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7d978" event={"ID":"1737c532-e69c-4f3c-8cc7-7b8c0b6d1167","Type":"ContainerStarted","Data":"ce0937560c0b1af42f67016a11bcd0dd1a6199c607d849452557c0a5296fa13c"} Jul 23 18:07:39.832145 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:39.831860 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzpn6" podStartSLOduration=65.441740564 podStartE2EDuration="1m10.831840591s" totalImagesPullingTime="5.390100027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:39.831541617 +0000 UTC m=+72.450431605" watchObservedRunningTime="2026-07-23 18:07:39.831840591 +0000 UTC m=+72.450730577" Jul 23 18:07:39.847019 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:39.846967 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7d978" podStartSLOduration=65.476734948 podStartE2EDuration="1m10.846949093s" totalImagesPullingTime="5.370214145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:39.84621781 +0000 UTC m=+72.465107797" watchObservedRunningTime="2026-07-23 18:07:39.846949093 +0000 UTC m=+72.465839078" Jul 23 18:07:58.469371 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.469210 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs"] Jul 23 18:07:58.473722 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.473696 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.479754 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.478228 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 18:07:58.479754 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.478525 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2xq5q\"" Jul 23 18:07:58.479754 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.478689 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 18:07:58.479754 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.478842 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 23 18:07:58.479754 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.479045 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 18:07:58.486424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.486115 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs"] Jul 23 18:07:58.548727 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.548684 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3e1bd61-e875-464e-ae46-14008a51d742-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs\" (UID: \"f3e1bd61-e875-464e-ae46-14008a51d742\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.548912 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.548748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rjd\" (UniqueName: \"kubernetes.io/projected/f3e1bd61-e875-464e-ae46-14008a51d742-kube-api-access-s2rjd\") pod \"managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs\" (UID: \"f3e1bd61-e875-464e-ae46-14008a51d742\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.649826 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.649777 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3e1bd61-e875-464e-ae46-14008a51d742-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs\" (UID: \"f3e1bd61-e875-464e-ae46-14008a51d742\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.650019 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.649844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rjd\" (UniqueName: \"kubernetes.io/projected/f3e1bd61-e875-464e-ae46-14008a51d742-kube-api-access-s2rjd\") pod \"managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs\" (UID: \"f3e1bd61-e875-464e-ae46-14008a51d742\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.652514 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.652482 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3e1bd61-e875-464e-ae46-14008a51d742-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs\" (UID: \"f3e1bd61-e875-464e-ae46-14008a51d742\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.658888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.658863 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rjd\" (UniqueName: \"kubernetes.io/projected/f3e1bd61-e875-464e-ae46-14008a51d742-kube-api-access-s2rjd\") pod \"managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs\" (UID: \"f3e1bd61-e875-464e-ae46-14008a51d742\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.799766 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.799732 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" Jul 23 18:07:58.925320 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:58.925290 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs"] Jul 23 18:07:58.928795 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:07:58.928758 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3e1bd61_e875_464e_ae46_14008a51d742.slice/crio-9a9f0492873c90cf396da49d2700b02a22f37d2784e5140f83ca5eb84b69dc82 WatchSource:0}: Error finding container 9a9f0492873c90cf396da49d2700b02a22f37d2784e5140f83ca5eb84b69dc82: Status 404 returned error can't find the container with id 9a9f0492873c90cf396da49d2700b02a22f37d2784e5140f83ca5eb84b69dc82 Jul 23 18:07:59.866168 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:07:59.866128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" event={"ID":"f3e1bd61-e875-464e-ae46-14008a51d742","Type":"ContainerStarted","Data":"9a9f0492873c90cf396da49d2700b02a22f37d2784e5140f83ca5eb84b69dc82"} Jul 23 18:08:01.873455 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:08:01.873419 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" event={"ID":"f3e1bd61-e875-464e-ae46-14008a51d742","Type":"ContainerStarted","Data":"279851a76a3b7a0744a7639a6b9e7b0aacef4d19bee8822807f6ef9c76dd1be0"} Jul 23 18:08:01.889278 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:08:01.889227 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" podStartSLOduration=1.454717739 podStartE2EDuration="3.889211044s" totalImagesPullingTime="2.434493305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:01.889066816 +0000 UTC m=+94.507956832" watchObservedRunningTime="2026-07-23 18:08:01.889211044 +0000 UTC m=+94.508101031" Jul 23 18:08:09.221180 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:08:09.221122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:08:09.221648 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:08:09.221275 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:08:09.221648 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:08:09.221362 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:09:13.221325514 +0000 UTC m=+165.840215477 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:08:10.822460 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:08:10.822423 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzpn6" Jul 23 18:08:37.619690 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:08:37.619640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:08:37.620103 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:08:37.619782 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 18:08:37.620103 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:08:37.619844 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:39.619828733 +0000 UTC m=+252.238718696 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : secret "metrics-daemon-secret" not found Jul 23 18:09:08.314601 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:09:08.314556 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j6kj4" podUID="932af207-0c99-4fa7-b8ac-106141a1f364" Jul 23 18:09:09.038243 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:09:09.038215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6kj4" Jul 23 18:09:09.535747 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:09:09.535636 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:09:13.265996 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:09:13.265937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:09:13.266529 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:09:13.266093 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:09:13.266529 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:09:13.266157 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls podName:932af207-0c99-4fa7-b8ac-106141a1f364 nodeName:}" failed. No retries permitted until 2026-07-23 18:11:15.266140448 +0000 UTC m=+287.885030410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls") pod "dns-default-j6kj4" (UID: "932af207-0c99-4fa7-b8ac-106141a1f364") : secret "dns-default-metrics-tls" not found Jul 23 18:09:21.510672 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:09:21.510589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:10:02.159848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:02.159811 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3e1bd61-e875-464e-ae46-14008a51d742" containerID="279851a76a3b7a0744a7639a6b9e7b0aacef4d19bee8822807f6ef9c76dd1be0" exitCode=255 Jul 23 18:10:02.160354 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:02.159889 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" event={"ID":"f3e1bd61-e875-464e-ae46-14008a51d742","Type":"ContainerDied","Data":"279851a76a3b7a0744a7639a6b9e7b0aacef4d19bee8822807f6ef9c76dd1be0"} Jul 23 18:10:02.165848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:02.165823 2572 scope.go:117] "RemoveContainer" containerID="279851a76a3b7a0744a7639a6b9e7b0aacef4d19bee8822807f6ef9c76dd1be0" Jul 23 18:10:03.164416 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:03.164382 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cdf9bb9cb-d4trs" event={"ID":"f3e1bd61-e875-464e-ae46-14008a51d742","Type":"ContainerStarted","Data":"2f4afa0a58f4d30ed26a833103bc22ff58596f78e8965132b29e6e69ff2183be"} Jul 23 18:10:39.667427 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:39.667386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:10:39.667930 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:39.667547 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 18:10:39.667930 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:39.667637 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs podName:c52668d7-cb37-4865-886e-de9262b6f8f0 nodeName:}" failed. No retries permitted until 2026-07-23 18:12:41.667621654 +0000 UTC m=+374.286511616 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs") pod "network-metrics-daemon-z8dkb" (UID: "c52668d7-cb37-4865-886e-de9262b6f8f0") : secret "metrics-daemon-secret" not found Jul 23 18:10:41.684143 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.684113 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g"] Jul 23 18:10:41.686955 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.686937 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4"] Jul 23 18:10:41.687075 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.687054 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.689556 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.689533 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh"] Jul 23 18:10:41.689675 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.689633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.691483 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.691459 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 23 18:10:41.691642 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.691522 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 23 18:10:41.691642 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.691549 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.691642 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.691587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bl2cv\"" Jul 23 18:10:41.691811 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.691715 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.692403 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.692379 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:41.692772 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.692750 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.692874 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.692772 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.692874 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.692815 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 23 18:10:41.693034 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.693015 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-657985476d-4nnxx"] Jul 23 18:10:41.693099 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.693082 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zh5vw\"" Jul 23 18:10:41.693153 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.693126 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 23 18:10:41.694718 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.694701 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 18:10:41.694921 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.694907 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.695161 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.695142 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.695239 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.695225 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dqfjn\"" Jul 23 18:10:41.695656 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.695639 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.697776 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.697748 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 18:10:41.697947 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.697920 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 18:10:41.698047 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.697985 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qzjmk\"" Jul 23 18:10:41.698047 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.697989 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 18:10:41.702098 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.702075 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4"] Jul 23 18:10:41.706134 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.706108 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 18:10:41.706256 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.706239 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g"] Jul 23 18:10:41.707243 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.707223 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh"] Jul 23 18:10:41.710070 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.710049 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-657985476d-4nnxx"] Jul 23 18:10:41.780821 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.780788 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g"] Jul 23 18:10:41.780998 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.780958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.780998 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.780984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-bound-sa-token\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781010 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-installation-pull-secrets\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b07263b-a539-4682-9432-1044314bd484-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781106 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-image-registry-private-configuration\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781141 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.781171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688mq\" (UniqueName: \"kubernetes.io/projected/5b07263b-a539-4682-9432-1044314bd484-kube-api-access-688mq\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-trusted-ca\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp4kh\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-kube-api-access-pp4kh\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-certificates\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17a11868-cc95-43bc-9607-ce42c1130fdf-ca-trust-extracted\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdnz6\" (UniqueName: \"kubernetes.io/projected/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-kube-api-access-vdnz6\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.781506 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.781389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbjjx\" (UniqueName: \"kubernetes.io/projected/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-kube-api-access-vbjjx\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:41.783598 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.783579 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp"] Jul 23 18:10:41.783710 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.783693 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" Jul 23 18:10:41.786091 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.786070 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.786201 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.786156 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.786385 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.786331 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.786606 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.786590 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zv7qs\"" Jul 23 18:10:41.788466 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.788440 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 23 18:10:41.788647 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.788606 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.788715 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.788650 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 23 18:10:41.788775 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.788718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.788775 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.788759 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-frwtd\"" Jul 23 18:10:41.795944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.795915 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g"] Jul 23 18:10:41.810749 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.810719 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp"] Jul 23 18:10:41.882096 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-config\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.882271 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbjjx\" (UniqueName: \"kubernetes.io/projected/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-kube-api-access-vbjjx\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:41.882271 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-bound-sa-token\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882425 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.882425 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzp5\" (UniqueName: \"kubernetes.io/projected/11d58b3f-5e2e-4994-9e94-702a656f6b02-kube-api-access-thzp5\") pod \"volume-data-source-validator-78cf4c6f6-zhc8g\" (UID: \"11d58b3f-5e2e-4994-9e94-702a656f6b02\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" Jul 23 18:10:41.882425 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcpzf\" (UniqueName: \"kubernetes.io/projected/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-kube-api-access-gcpzf\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.882425 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-image-registry-private-configuration\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882576 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.882439 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:41.882576 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.882576 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-trusted-ca\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882576 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.882504 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls podName:5b07263b-a539-4682-9432-1044314bd484 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:42.382477385 +0000 UTC m=+255.001367361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vgq5g" (UID: "5b07263b-a539-4682-9432-1044314bd484") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:41.882576 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-certificates\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882808 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17a11868-cc95-43bc-9607-ce42c1130fdf-ca-trust-extracted\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882808 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdnz6\" (UniqueName: \"kubernetes.io/projected/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-kube-api-access-vdnz6\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.882808 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-serving-cert\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.882957 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-installation-pull-secrets\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882957 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.882957 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b07263b-a539-4682-9432-1044314bd484-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.882957 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.882957 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.882975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688mq\" (UniqueName: \"kubernetes.io/projected/5b07263b-a539-4682-9432-1044314bd484-kube-api-access-688mq\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.883001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp4kh\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-kube-api-access-pp4kh\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.883001 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17a11868-cc95-43bc-9607-ce42c1130fdf-ca-trust-extracted\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.883082 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.883099 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-657985476d-4nnxx: secret "image-registry-tls" not found Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.883137 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.883161 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls podName:17a11868-cc95-43bc-9607-ce42c1130fdf nodeName:}" failed. No retries permitted until 2026-07-23 18:10:42.383143259 +0000 UTC m=+255.002033236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls") pod "image-registry-657985476d-4nnxx" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf") : secret "image-registry-tls" not found Jul 23 18:10:41.883189 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:41.883192 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls podName:0ba9adf5-5f41-42da-9d57-aca3eb33ca64 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:42.383175683 +0000 UTC m=+255.002065649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zg2gh" (UID: "0ba9adf5-5f41-42da-9d57-aca3eb33ca64") : secret "samples-operator-tls" not found Jul 23 18:10:41.883629 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.883528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-certificates\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.883739 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.883710 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.883864 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.883775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-trusted-ca\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.884225 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.884199 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b07263b-a539-4682-9432-1044314bd484-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.885054 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.885033 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-image-registry-private-configuration\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.885054 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.885042 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.885656 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.885638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-installation-pull-secrets\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.891518 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.891494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-bound-sa-token\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.891680 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.891664 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdnz6\" (UniqueName: \"kubernetes.io/projected/33d5cb9a-1941-4860-89e0-3bc19b7d56a7-kube-api-access-vdnz6\") pod \"kube-storage-version-migrator-operator-7658d9b749-tp2r4\" (UID: \"33d5cb9a-1941-4860-89e0-3bc19b7d56a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:41.891761 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.891677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbjjx\" (UniqueName: \"kubernetes.io/projected/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-kube-api-access-vbjjx\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:41.892262 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.892242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-688mq\" (UniqueName: \"kubernetes.io/projected/5b07263b-a539-4682-9432-1044314bd484-kube-api-access-688mq\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:41.892583 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.892567 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp4kh\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-kube-api-access-pp4kh\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:41.983748 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.983655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-config\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.983748 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.983712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzp5\" (UniqueName: \"kubernetes.io/projected/11d58b3f-5e2e-4994-9e94-702a656f6b02-kube-api-access-thzp5\") pod \"volume-data-source-validator-78cf4c6f6-zhc8g\" (UID: \"11d58b3f-5e2e-4994-9e94-702a656f6b02\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" Jul 23 18:10:41.983748 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.983733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcpzf\" (UniqueName: \"kubernetes.io/projected/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-kube-api-access-gcpzf\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.984024 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.983771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-serving-cert\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.984292 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.984269 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-config\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.986079 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.986062 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-serving-cert\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.993070 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.993040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcpzf\" (UniqueName: \"kubernetes.io/projected/e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec-kube-api-access-gcpzf\") pod \"service-ca-operator-5bcbc94c78-lv7wp\" (UID: \"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:41.993168 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:41.993121 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzp5\" (UniqueName: \"kubernetes.io/projected/11d58b3f-5e2e-4994-9e94-702a656f6b02-kube-api-access-thzp5\") pod \"volume-data-source-validator-78cf4c6f6-zhc8g\" (UID: \"11d58b3f-5e2e-4994-9e94-702a656f6b02\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" Jul 23 18:10:42.005075 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.005050 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" Jul 23 18:10:42.093612 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.093575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" Jul 23 18:10:42.100079 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.100012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" Jul 23 18:10:42.134789 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.134746 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4"] Jul 23 18:10:42.137799 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:10:42.137758 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d5cb9a_1941_4860_89e0_3bc19b7d56a7.slice/crio-93c8250ab07b54fd37fe7453652470a00f26308c8b3d18b325b669211324216e WatchSource:0}: Error finding container 93c8250ab07b54fd37fe7453652470a00f26308c8b3d18b325b669211324216e: Status 404 returned error can't find the container with id 93c8250ab07b54fd37fe7453652470a00f26308c8b3d18b325b669211324216e Jul 23 18:10:42.241144 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.241062 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g"] Jul 23 18:10:42.244221 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:10:42.244192 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d58b3f_5e2e_4994_9e94_702a656f6b02.slice/crio-a3992daf67314f98df28fb09715c0a6956e91440f94ef898fcdad589609fcae6 WatchSource:0}: Error finding container a3992daf67314f98df28fb09715c0a6956e91440f94ef898fcdad589609fcae6: Status 404 returned error can't find the container with id a3992daf67314f98df28fb09715c0a6956e91440f94ef898fcdad589609fcae6 Jul 23 18:10:42.259473 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.259448 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp"] Jul 23 18:10:42.262992 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:10:42.262967 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b0f1ea_1b4d_48ae_8a65_46d9cdb3bfec.slice/crio-8467aea4239ad7e1baf9c16a7b0d3792fb2f66bebfe0f7e5fa41c41356b69b24 WatchSource:0}: Error finding container 8467aea4239ad7e1baf9c16a7b0d3792fb2f66bebfe0f7e5fa41c41356b69b24: Status 404 returned error can't find the container with id 8467aea4239ad7e1baf9c16a7b0d3792fb2f66bebfe0f7e5fa41c41356b69b24 Jul 23 18:10:42.281212 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.281167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" event={"ID":"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec","Type":"ContainerStarted","Data":"8467aea4239ad7e1baf9c16a7b0d3792fb2f66bebfe0f7e5fa41c41356b69b24"} Jul 23 18:10:42.282396 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.282365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" event={"ID":"11d58b3f-5e2e-4994-9e94-702a656f6b02","Type":"ContainerStarted","Data":"a3992daf67314f98df28fb09715c0a6956e91440f94ef898fcdad589609fcae6"} Jul 23 18:10:42.283523 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.283492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" event={"ID":"33d5cb9a-1941-4860-89e0-3bc19b7d56a7","Type":"ContainerStarted","Data":"93c8250ab07b54fd37fe7453652470a00f26308c8b3d18b325b669211324216e"} Jul 23 18:10:42.386855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.386808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:42.386855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.386855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.386970 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.386981 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.387005 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-657985476d-4nnxx: secret "image-registry-tls" not found Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.387024 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls podName:0ba9adf5-5f41-42da-9d57-aca3eb33ca64 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:43.387008047 +0000 UTC m=+256.005898010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zg2gh" (UID: "0ba9adf5-5f41-42da-9d57-aca3eb33ca64") : secret "samples-operator-tls" not found Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:42.387043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.387062 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls podName:17a11868-cc95-43bc-9607-ce42c1130fdf nodeName:}" failed. No retries permitted until 2026-07-23 18:10:43.387044916 +0000 UTC m=+256.005934895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls") pod "image-registry-657985476d-4nnxx" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf") : secret "image-registry-tls" not found Jul 23 18:10:42.387116 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.387096 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:42.387417 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:42.387136 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls podName:5b07263b-a539-4682-9432-1044314bd484 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:43.387125008 +0000 UTC m=+256.006014972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vgq5g" (UID: "5b07263b-a539-4682-9432-1044314bd484") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:43.397046 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:43.397000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:43.397093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:43.397140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397180 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397260 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397269 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls podName:5b07263b-a539-4682-9432-1044314bd484 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.397248398 +0000 UTC m=+258.016138360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vgq5g" (UID: "5b07263b-a539-4682-9432-1044314bd484") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397313 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls podName:0ba9adf5-5f41-42da-9d57-aca3eb33ca64 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.397298512 +0000 UTC m=+258.016188477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zg2gh" (UID: "0ba9adf5-5f41-42da-9d57-aca3eb33ca64") : secret "samples-operator-tls" not found Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397265 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397354 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-657985476d-4nnxx: secret "image-registry-tls" not found Jul 23 18:10:43.397557 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:43.397416 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls podName:17a11868-cc95-43bc-9607-ce42c1130fdf nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.397399713 +0000 UTC m=+258.016289694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls") pod "image-registry-657985476d-4nnxx" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf") : secret "image-registry-tls" not found Jul 23 18:10:44.292113 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:44.292073 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" event={"ID":"11d58b3f-5e2e-4994-9e94-702a656f6b02","Type":"ContainerStarted","Data":"23d422111838e5ebe8c13f9502050346a1864c211b8860a5ca0301e9fd961829"} Jul 23 18:10:44.309760 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:44.309684 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-zhc8g" podStartSLOduration=1.846063239 podStartE2EDuration="3.309660481s" totalImagesPullingTime="1.463597242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:44.308885303 +0000 UTC m=+256.927775289" watchObservedRunningTime="2026-07-23 18:10:44.309660481 +0000 UTC m=+256.928550469" Jul 23 18:10:45.249588 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.249482 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xd9x5"] Jul 23 18:10:45.252888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.252866 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.255610 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.255581 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 18:10:45.255610 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.255604 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 18:10:45.255796 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.255671 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 18:10:45.256045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.256030 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 18:10:45.256711 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.256695 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k9g92\"" Jul 23 18:10:45.266958 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.266925 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xd9x5"] Jul 23 18:10:45.298018 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.297950 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" event={"ID":"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec","Type":"ContainerStarted","Data":"30f05a396de7685e1b4f8f5b3417bca4b1a5a5d53610e73bbd57bb5bcfdd17b2"} Jul 23 18:10:45.299636 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.299608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" event={"ID":"33d5cb9a-1941-4860-89e0-3bc19b7d56a7","Type":"ContainerStarted","Data":"72d05737a7a953d167ef4707f5dd66120dc0c2b595c20a35a178bb5ceb791c8c"} Jul 23 18:10:45.313221 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.313169 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" podStartSLOduration=1.679864102 podStartE2EDuration="4.313152984s" totalImagesPullingTime="2.633288882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:45.311917866 +0000 UTC m=+257.930807852" watchObservedRunningTime="2026-07-23 18:10:45.313152984 +0000 UTC m=+257.932042948" Jul 23 18:10:45.335160 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.335105 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" podStartSLOduration=1.575061939 podStartE2EDuration="4.335086476s" totalImagesPullingTime="2.760024537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:45.334662898 +0000 UTC m=+257.953552883" watchObservedRunningTime="2026-07-23 18:10:45.335086476 +0000 UTC m=+257.953976498" Jul 23 18:10:45.415123 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:45.415329 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415167 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.415329 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf03283f-e83e-4b49-b8f6-715edf72281b-data-volume\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.415329 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.415283 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:45.415521 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.415414 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls podName:5b07263b-a539-4682-9432-1044314bd484 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.415392905 +0000 UTC m=+262.034282869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vgq5g" (UID: "5b07263b-a539-4682-9432-1044314bd484") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:45.415785 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95npw\" (UniqueName: \"kubernetes.io/projected/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-api-access-95npw\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.415912 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf03283f-e83e-4b49-b8f6-715edf72281b-crio-socket\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.415912 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:45.415912 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:45.415912 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.415911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.416077 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.415923 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:10:45.416077 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.415939 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-657985476d-4nnxx: secret "image-registry-tls" not found Jul 23 18:10:45.416077 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.415995 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:10:45.416077 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.416041 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls podName:17a11868-cc95-43bc-9607-ce42c1130fdf nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.416022551 +0000 UTC m=+262.034912526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls") pod "image-registry-657985476d-4nnxx" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf") : secret "image-registry-tls" not found Jul 23 18:10:45.416077 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.416060 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls podName:0ba9adf5-5f41-42da-9d57-aca3eb33ca64 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.416049091 +0000 UTC m=+262.034939053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zg2gh" (UID: "0ba9adf5-5f41-42da-9d57-aca3eb33ca64") : secret "samples-operator-tls" not found Jul 23 18:10:45.516539 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf03283f-e83e-4b49-b8f6-715edf72281b-data-volume\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516539 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95npw\" (UniqueName: \"kubernetes.io/projected/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-api-access-95npw\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516539 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf03283f-e83e-4b49-b8f6-715edf72281b-crio-socket\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516681 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf03283f-e83e-4b49-b8f6-715edf72281b-crio-socket\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.516702 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.516749 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.516832 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:46.016783969 +0000 UTC m=+258.635673936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : configmap "kube-rbac-proxy" not found Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.516837 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf03283f-e83e-4b49-b8f6-715edf72281b-data-volume\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:45.516848 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:45.516852 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:46.016843126 +0000 UTC m=+258.635733102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:45.525420 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:45.525392 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95npw\" (UniqueName: \"kubernetes.io/projected/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-api-access-95npw\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:46.020180 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:46.020135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:46.020382 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:46.020237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:46.020382 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:46.020279 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:46.020382 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:46.020355 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:47.020327783 +0000 UTC m=+259.639217746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:46.020536 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:46.020381 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:46.020536 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:46.020453 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:47.020432608 +0000 UTC m=+259.639322578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : configmap "kube-rbac-proxy" not found Jul 23 18:10:47.032386 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:47.032315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:47.032880 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:47.032505 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:47.032880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:47.032518 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:47.032880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:47.032593 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:47.032880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:47.032609 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.032588027 +0000 UTC m=+261.651477991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:47.032880 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:47.032634 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.032622729 +0000 UTC m=+261.651512691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : configmap "kube-rbac-proxy" not found Jul 23 18:10:47.424477 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:47.424441 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vtmfd_05a8347e-f1f4-4635-bb0a-a3898f8ea9d6/dns-node-resolver/0.log" Jul 23 18:10:48.223963 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.223934 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mw6z5_8a0e9307-d975-447c-9196-9f5b2e3131ac/node-ca/0.log" Jul 23 18:10:48.632935 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.632896 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gdhks"] Jul 23 18:10:48.637169 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.637143 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.639747 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.639711 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8787m\"" Jul 23 18:10:48.639899 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.639787 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 23 18:10:48.640897 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.640865 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 23 18:10:48.640897 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.640892 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 23 18:10:48.641109 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.640984 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 23 18:10:48.645143 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.645117 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gdhks"] Jul 23 18:10:48.646087 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.646063 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6ef5623-5591-4531-8214-6204e33a8c84-signing-key\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.646209 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.646106 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nnw\" (UniqueName: \"kubernetes.io/projected/b6ef5623-5591-4531-8214-6204e33a8c84-kube-api-access-j4nnw\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.646209 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.646163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6ef5623-5591-4531-8214-6204e33a8c84-signing-cabundle\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.747282 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.747244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nnw\" (UniqueName: \"kubernetes.io/projected/b6ef5623-5591-4531-8214-6204e33a8c84-kube-api-access-j4nnw\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.747492 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.747304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6ef5623-5591-4531-8214-6204e33a8c84-signing-cabundle\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.747492 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.747427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6ef5623-5591-4531-8214-6204e33a8c84-signing-key\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.747950 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.747921 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6ef5623-5591-4531-8214-6204e33a8c84-signing-cabundle\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.749853 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.749831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6ef5623-5591-4531-8214-6204e33a8c84-signing-key\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.755667 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.755647 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nnw\" (UniqueName: \"kubernetes.io/projected/b6ef5623-5591-4531-8214-6204e33a8c84-kube-api-access-j4nnw\") pod \"service-ca-58598695f7-gdhks\" (UID: \"b6ef5623-5591-4531-8214-6204e33a8c84\") " pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:48.824730 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.824701 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vmgn_d32bf6fa-e4a0-480a-803d-c2da79c18e17/serve-healthcheck-canary/0.log" Jul 23 18:10:48.946787 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:48.946694 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gdhks" Jul 23 18:10:49.049916 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.049883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:49.050093 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.050016 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:49.050093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.050058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:49.050093 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.050083 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:53.050064829 +0000 UTC m=+265.668954796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : configmap "kube-rbac-proxy" not found Jul 23 18:10:49.050264 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.050166 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:49.050264 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.050230 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:53.050211969 +0000 UTC m=+265.669101936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:49.076112 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.075988 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gdhks"] Jul 23 18:10:49.078524 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:10:49.078489 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ef5623_5591_4531_8214_6204e33a8c84.slice/crio-773ee365f802fab6304cd03f418c94117e7ba845611f39456f790b047c19ab19 WatchSource:0}: Error finding container 773ee365f802fab6304cd03f418c94117e7ba845611f39456f790b047c19ab19: Status 404 returned error can't find the container with id 773ee365f802fab6304cd03f418c94117e7ba845611f39456f790b047c19ab19 Jul 23 18:10:49.313887 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.313850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gdhks" event={"ID":"b6ef5623-5591-4531-8214-6204e33a8c84","Type":"ContainerStarted","Data":"123719a61f1d054ecf3135e1d0d194bd40354294ef8bd9c0c2f8bdf6220f59a2"} Jul 23 18:10:49.314278 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.313900 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gdhks" event={"ID":"b6ef5623-5591-4531-8214-6204e33a8c84","Type":"ContainerStarted","Data":"773ee365f802fab6304cd03f418c94117e7ba845611f39456f790b047c19ab19"} Jul 23 18:10:49.453279 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.453202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:49.453279 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.453240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:49.453305 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453392 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453417 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-657985476d-4nnxx: secret "image-registry-tls" not found Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453428 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453452 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453485 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls podName:0ba9adf5-5f41-42da-9d57-aca3eb33ca64 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:57.453467074 +0000 UTC m=+270.072357040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-zg2gh" (UID: "0ba9adf5-5f41-42da-9d57-aca3eb33ca64") : secret "samples-operator-tls" not found Jul 23 18:10:49.453503 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453500 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls podName:5b07263b-a539-4682-9432-1044314bd484 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:57.453493692 +0000 UTC m=+270.072383655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-vgq5g" (UID: "5b07263b-a539-4682-9432-1044314bd484") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:10:49.453725 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:49.453513 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls podName:17a11868-cc95-43bc-9607-ce42c1130fdf nodeName:}" failed. No retries permitted until 2026-07-23 18:10:57.453506136 +0000 UTC m=+270.072396099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls") pod "image-registry-657985476d-4nnxx" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf") : secret "image-registry-tls" not found Jul 23 18:10:53.083411 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:53.083365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:53.083813 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:53.083474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:10:53.083813 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:53.083496 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:53.083813 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:53.083562 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:11:01.083546749 +0000 UTC m=+273.702436717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : configmap "kube-rbac-proxy" not found Jul 23 18:10:53.083813 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:53.083617 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:53.083813 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:10:53.083677 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls podName:cf03283f-e83e-4b49-b8f6-715edf72281b nodeName:}" failed. No retries permitted until 2026-07-23 18:11:01.083662155 +0000 UTC m=+273.702552124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xd9x5" (UID: "cf03283f-e83e-4b49-b8f6-715edf72281b") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:57.522019 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.521980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:57.522432 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.522071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:57.522432 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.522093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:57.524695 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.524666 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b07263b-a539-4682-9432-1044314bd484-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-vgq5g\" (UID: \"5b07263b-a539-4682-9432-1044314bd484\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:57.524802 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.524693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ba9adf5-5f41-42da-9d57-aca3eb33ca64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-zg2gh\" (UID: \"0ba9adf5-5f41-42da-9d57-aca3eb33ca64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:57.524802 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.524693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"image-registry-657985476d-4nnxx\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:57.597756 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.597720 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" Jul 23 18:10:57.614073 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.614038 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" Jul 23 18:10:57.618224 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.618200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:57.764387 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.764026 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-gdhks" podStartSLOduration=9.763999803 podStartE2EDuration="9.763999803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:49.332282424 +0000 UTC m=+261.951172410" watchObservedRunningTime="2026-07-23 18:10:57.763999803 +0000 UTC m=+270.382889791" Jul 23 18:10:57.764387 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.764262 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g"] Jul 23 18:10:57.788846 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.788809 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh"] Jul 23 18:10:57.806693 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:57.806664 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-657985476d-4nnxx"] Jul 23 18:10:57.810421 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:10:57.810380 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a11868_cc95_43bc_9607_ce42c1130fdf.slice/crio-44994a3a55d5d758bcf43ba7d07af86400528eac52a98209647aba3f65fe3068 WatchSource:0}: Error finding container 44994a3a55d5d758bcf43ba7d07af86400528eac52a98209647aba3f65fe3068: Status 404 returned error can't find the container with id 44994a3a55d5d758bcf43ba7d07af86400528eac52a98209647aba3f65fe3068 Jul 23 18:10:58.348169 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:58.348126 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" event={"ID":"0ba9adf5-5f41-42da-9d57-aca3eb33ca64","Type":"ContainerStarted","Data":"422700ca4cbc8a98993d39903e8ebda5d4f1953638fe599ac1047a342ad4c236"} Jul 23 18:10:58.349479 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:58.349448 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" event={"ID":"5b07263b-a539-4682-9432-1044314bd484","Type":"ContainerStarted","Data":"0cd025d3bef81778169b5e6d34a9efb7ac8bc9af7b61bf1625aba4b61c3a7d82"} Jul 23 18:10:58.351149 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:58.351117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-657985476d-4nnxx" event={"ID":"17a11868-cc95-43bc-9607-ce42c1130fdf","Type":"ContainerStarted","Data":"89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000"} Jul 23 18:10:58.351254 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:58.351162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-657985476d-4nnxx" event={"ID":"17a11868-cc95-43bc-9607-ce42c1130fdf","Type":"ContainerStarted","Data":"44994a3a55d5d758bcf43ba7d07af86400528eac52a98209647aba3f65fe3068"} Jul 23 18:10:58.351336 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:58.351252 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:10:58.375980 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:10:58.375916 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-657985476d-4nnxx" podStartSLOduration=17.375892798 podStartE2EDuration="17.375892798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:58.373778332 +0000 UTC m=+270.992668329" watchObservedRunningTime="2026-07-23 18:10:58.375892798 +0000 UTC m=+270.994782784" Jul 23 18:11:00.360097 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:00.360052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" event={"ID":"0ba9adf5-5f41-42da-9d57-aca3eb33ca64","Type":"ContainerStarted","Data":"28f13b124efbcc75cae5ec8fc2e6ef31b269d7756294240b916e636b026d0698"} Jul 23 18:11:00.360607 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:00.360120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" event={"ID":"0ba9adf5-5f41-42da-9d57-aca3eb33ca64","Type":"ContainerStarted","Data":"862e706d51d753edbb016e8181b88230a3fb1bdb6462fd00ad61e105a20f9ec8"} Jul 23 18:11:00.361502 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:00.361476 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" event={"ID":"5b07263b-a539-4682-9432-1044314bd484","Type":"ContainerStarted","Data":"850c660b4b9028dc74b695095908f9205b78e87bb414ec6bb2ec2743dc507e95"} Jul 23 18:11:00.378888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:00.378832 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-zg2gh" podStartSLOduration=17.699098855 podStartE2EDuration="19.378814204s" totalImagesPullingTime="1.679715349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:00.378193271 +0000 UTC m=+272.997083257" watchObservedRunningTime="2026-07-23 18:11:00.378814204 +0000 UTC m=+272.997704199" Jul 23 18:11:00.396398 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:00.396264 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-vgq5g" podStartSLOduration=17.022217568 podStartE2EDuration="19.396244865s" totalImagesPullingTime="2.374027297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:00.395996145 +0000 UTC m=+273.014886144" watchObservedRunningTime="2026-07-23 18:11:00.396244865 +0000 UTC m=+273.015134857" Jul 23 18:11:01.154015 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.153977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:11:01.154182 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.154069 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:11:01.154628 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.154606 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf03283f-e83e-4b49-b8f6-715edf72281b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:11:01.156248 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.156223 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf03283f-e83e-4b49-b8f6-715edf72281b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xd9x5\" (UID: \"cf03283f-e83e-4b49-b8f6-715edf72281b\") " pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:11:01.163371 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.163329 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xd9x5" Jul 23 18:11:01.296261 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.296228 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xd9x5"] Jul 23 18:11:01.299493 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:01.299463 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf03283f_e83e_4b49_b8f6_715edf72281b.slice/crio-cc1273f9ec304d7fa6cdb13c67a9d6c4ce80befa77668e6122f447b6e3ba3e45 WatchSource:0}: Error finding container cc1273f9ec304d7fa6cdb13c67a9d6c4ce80befa77668e6122f447b6e3ba3e45: Status 404 returned error can't find the container with id cc1273f9ec304d7fa6cdb13c67a9d6c4ce80befa77668e6122f447b6e3ba3e45 Jul 23 18:11:01.366062 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:01.366025 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xd9x5" event={"ID":"cf03283f-e83e-4b49-b8f6-715edf72281b","Type":"ContainerStarted","Data":"cc1273f9ec304d7fa6cdb13c67a9d6c4ce80befa77668e6122f447b6e3ba3e45"} Jul 23 18:11:07.389129 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:07.389094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xd9x5" event={"ID":"cf03283f-e83e-4b49-b8f6-715edf72281b","Type":"ContainerStarted","Data":"e5a2ab17e0c80155c266b0febd4dac9b3cfb19956e8fa5934967482b3f5267be"} Jul 23 18:11:09.748518 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:09.748483 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-657985476d-4nnxx"] Jul 23 18:11:10.403701 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:10.403665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xd9x5" event={"ID":"cf03283f-e83e-4b49-b8f6-715edf72281b","Type":"ContainerStarted","Data":"6c255e1d376d86fda642d5133488a3730079c86f17c3823b0c92f02d85b9db55"} Jul 23 18:11:12.039233 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:11:12.039178 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j6kj4" podUID="932af207-0c99-4fa7-b8ac-106141a1f364" Jul 23 18:11:12.412008 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:12.411935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6kj4" Jul 23 18:11:13.707515 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.705449 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj"] Jul 23 18:11:13.710858 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.710828 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.713843 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.713816 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 18:11:13.715324 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.715301 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 23 18:11:13.715518 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.715473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hjn7g\"" Jul 23 18:11:13.715518 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.715499 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 23 18:11:13.717660 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.717419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj"] Jul 23 18:11:13.866640 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.866604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgqb\" (UniqueName: \"kubernetes.io/projected/b73d7e58-14f5-44a3-b3b1-e758eae53cef-kube-api-access-mkgqb\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.866829 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.866673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73d7e58-14f5-44a3-b3b1-e758eae53cef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.866881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.866826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b73d7e58-14f5-44a3-b3b1-e758eae53cef-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.866881 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.866863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73d7e58-14f5-44a3-b3b1-e758eae53cef-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.968278 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.968235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73d7e58-14f5-44a3-b3b1-e758eae53cef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.968484 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.968308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b73d7e58-14f5-44a3-b3b1-e758eae53cef-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.968484 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.968333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73d7e58-14f5-44a3-b3b1-e758eae53cef-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.968484 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.968376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgqb\" (UniqueName: \"kubernetes.io/projected/b73d7e58-14f5-44a3-b3b1-e758eae53cef-kube-api-access-mkgqb\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.969081 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.969054 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73d7e58-14f5-44a3-b3b1-e758eae53cef-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.970747 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.970717 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73d7e58-14f5-44a3-b3b1-e758eae53cef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.970833 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.970800 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b73d7e58-14f5-44a3-b3b1-e758eae53cef-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:13.977641 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:13.977617 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgqb\" (UniqueName: \"kubernetes.io/projected/b73d7e58-14f5-44a3-b3b1-e758eae53cef-kube-api-access-mkgqb\") pod \"prometheus-operator-5945b5cfd-m5qrj\" (UID: \"b73d7e58-14f5-44a3-b3b1-e758eae53cef\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:14.020689 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:14.020653 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" Jul 23 18:11:14.150141 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:14.150065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj"] Jul 23 18:11:14.152891 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:14.152860 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73d7e58_14f5_44a3_b3b1_e758eae53cef.slice/crio-35442471ca1ff7688ac78ff833a9f16a78f5ba1320df960a915c372aea08e1eb WatchSource:0}: Error finding container 35442471ca1ff7688ac78ff833a9f16a78f5ba1320df960a915c372aea08e1eb: Status 404 returned error can't find the container with id 35442471ca1ff7688ac78ff833a9f16a78f5ba1320df960a915c372aea08e1eb Jul 23 18:11:14.420535 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:14.420425 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xd9x5" event={"ID":"cf03283f-e83e-4b49-b8f6-715edf72281b","Type":"ContainerStarted","Data":"c5211d4a2ccd83262578abc9c175e9b04dd451a3983cd338977260680e8d193a"} Jul 23 18:11:14.421635 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:14.421613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" event={"ID":"b73d7e58-14f5-44a3-b3b1-e758eae53cef","Type":"ContainerStarted","Data":"35442471ca1ff7688ac78ff833a9f16a78f5ba1320df960a915c372aea08e1eb"} Jul 23 18:11:14.440689 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:14.440641 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xd9x5" podStartSLOduration=17.394308577 podStartE2EDuration="29.440623804s" totalImagesPullingTime="12.046315227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:10:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:14.439894742 +0000 UTC m=+287.058784726" watchObservedRunningTime="2026-07-23 18:11:14.440623804 +0000 UTC m=+287.059513789" Jul 23 18:11:15.279648 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:15.279606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:11:15.282424 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:15.282388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/932af207-0c99-4fa7-b8ac-106141a1f364-metrics-tls\") pod \"dns-default-j6kj4\" (UID: \"932af207-0c99-4fa7-b8ac-106141a1f364\") " pod="openshift-dns/dns-default-j6kj4" Jul 23 18:11:15.416107 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:15.416080 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6k4rc\"" Jul 23 18:11:15.423532 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:15.423507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j6kj4" Jul 23 18:11:15.426785 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:15.426755 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" event={"ID":"b73d7e58-14f5-44a3-b3b1-e758eae53cef","Type":"ContainerStarted","Data":"06e303e109051c1b5fa921da18001dd1211529276262a458a9723703d362e5ac"} Jul 23 18:11:15.565000 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:15.564966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j6kj4"] Jul 23 18:11:15.568213 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:15.568175 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932af207_0c99_4fa7_b8ac_106141a1f364.slice/crio-4046f7fc4c7844d89db51ca0d8ea9d9985abdfd99056aeacb1c007e5d9d2c0b5 WatchSource:0}: Error finding container 4046f7fc4c7844d89db51ca0d8ea9d9985abdfd99056aeacb1c007e5d9d2c0b5: Status 404 returned error can't find the container with id 4046f7fc4c7844d89db51ca0d8ea9d9985abdfd99056aeacb1c007e5d9d2c0b5 Jul 23 18:11:16.433068 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:16.433027 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" event={"ID":"b73d7e58-14f5-44a3-b3b1-e758eae53cef","Type":"ContainerStarted","Data":"d62d1a4400358eb4ec730d7defe708deaa3cb8497e945871b2e4705733df7420"} Jul 23 18:11:16.434335 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:16.434300 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6kj4" event={"ID":"932af207-0c99-4fa7-b8ac-106141a1f364","Type":"ContainerStarted","Data":"4046f7fc4c7844d89db51ca0d8ea9d9985abdfd99056aeacb1c007e5d9d2c0b5"} Jul 23 18:11:16.452236 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:16.452174 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m5qrj" podStartSLOduration=2.242774757 podStartE2EDuration="3.452149688s" totalImagesPullingTime="1.209374931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:16.450932483 +0000 UTC m=+289.069822470" watchObservedRunningTime="2026-07-23 18:11:16.452149688 +0000 UTC m=+289.071039675" Jul 23 18:11:18.096407 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.096358 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tnz9q"] Jul 23 18:11:18.099712 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.099689 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.104651 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.102969 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 18:11:18.104651 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.103082 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 18:11:18.104651 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.103107 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fkd8l\"" Jul 23 18:11:18.104651 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.103404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 18:11:18.203045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkzxn\" (UniqueName: \"kubernetes.io/projected/8b1787e5-4cb4-45a6-be12-6e2498303cf3-kube-api-access-rkzxn\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203285 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-wtmp\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203285 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1787e5-4cb4-45a6-be12-6e2498303cf3-metrics-client-ca\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203285 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-root\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203285 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-sys\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-textfile\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.203516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.203402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-tls\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.304808 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkzxn\" (UniqueName: \"kubernetes.io/projected/8b1787e5-4cb4-45a6-be12-6e2498303cf3-kube-api-access-rkzxn\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.304808 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-wtmp\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1787e5-4cb4-45a6-be12-6e2498303cf3-metrics-client-ca\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-root\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-sys\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.304999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305045 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-textfile\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305397 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-tls\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305397 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305079 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-sys\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305397 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305137 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-root\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305397 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305036 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-wtmp\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305598 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305451 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-textfile\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305711 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1787e5-4cb4-45a6-be12-6e2498303cf3-metrics-client-ca\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.305711 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.305700 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.307985 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.307963 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-tls\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.308309 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.308288 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b1787e5-4cb4-45a6-be12-6e2498303cf3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.314126 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.314095 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkzxn\" (UniqueName: \"kubernetes.io/projected/8b1787e5-4cb4-45a6-be12-6e2498303cf3-kube-api-access-rkzxn\") pod \"node-exporter-tnz9q\" (UID: \"8b1787e5-4cb4-45a6-be12-6e2498303cf3\") " pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.418279 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.418182 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tnz9q" Jul 23 18:11:18.431565 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:18.431530 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1787e5_4cb4_45a6_be12_6e2498303cf3.slice/crio-a4eb582dfa65c569ddcfa77f393e30a6bbd2759b85f6715d3f6efdf481edf7b0 WatchSource:0}: Error finding container a4eb582dfa65c569ddcfa77f393e30a6bbd2759b85f6715d3f6efdf481edf7b0: Status 404 returned error can't find the container with id a4eb582dfa65c569ddcfa77f393e30a6bbd2759b85f6715d3f6efdf481edf7b0 Jul 23 18:11:18.442207 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.442172 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnz9q" event={"ID":"8b1787e5-4cb4-45a6-be12-6e2498303cf3","Type":"ContainerStarted","Data":"a4eb582dfa65c569ddcfa77f393e30a6bbd2759b85f6715d3f6efdf481edf7b0"} Jul 23 18:11:18.444376 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.444299 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6kj4" event={"ID":"932af207-0c99-4fa7-b8ac-106141a1f364","Type":"ContainerStarted","Data":"8c111c33f9ca0b11af570c98e69b5a08a97ca4e07c6c2e6e7cabb150ff932d91"} Jul 23 18:11:18.444538 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.444377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j6kj4" event={"ID":"932af207-0c99-4fa7-b8ac-106141a1f364","Type":"ContainerStarted","Data":"8cfe99e546eeae39869d984b5b780b923dba7d1cd99c0bb54531e37c71a673cd"} Jul 23 18:11:18.444538 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.444441 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j6kj4" Jul 23 18:11:18.463716 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:18.463655 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j6kj4" podStartSLOduration=251.611260974 podStartE2EDuration="4m13.463630727s" totalImagesPullingTime="1.852369753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:18.462006074 +0000 UTC m=+291.080896064" watchObservedRunningTime="2026-07-23 18:11:18.463630727 +0000 UTC m=+291.082520715" Jul 23 18:11:19.450301 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:19.450259 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnz9q" event={"ID":"8b1787e5-4cb4-45a6-be12-6e2498303cf3","Type":"ContainerStarted","Data":"44672dd8adb17189da18bb46ada891fae0915e5f614cf74e70bc3bbd12c2efe9"} Jul 23 18:11:19.754586 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:19.754495 2572 patch_prober.go:28] interesting pod/image-registry-657985476d-4nnxx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 18:11:19.754586 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:19.754563 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-657985476d-4nnxx" podUID="17a11868-cc95-43bc-9607-ce42c1130fdf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 18:11:20.455759 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:20.455722 2572 generic.go:356] "Generic (PLEG): container finished" podID="8b1787e5-4cb4-45a6-be12-6e2498303cf3" containerID="44672dd8adb17189da18bb46ada891fae0915e5f614cf74e70bc3bbd12c2efe9" exitCode=0 Jul 23 18:11:20.455759 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:20.455758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnz9q" event={"ID":"8b1787e5-4cb4-45a6-be12-6e2498303cf3","Type":"ContainerDied","Data":"44672dd8adb17189da18bb46ada891fae0915e5f614cf74e70bc3bbd12c2efe9"} Jul 23 18:11:21.110975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.110939 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74458f7f68-mhbxf"] Jul 23 18:11:21.114467 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.114445 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.117830 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.117766 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 18:11:21.117961 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.117850 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5uehh09m9q3lc\"" Jul 23 18:11:21.117961 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.117899 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 18:11:21.117961 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.117955 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 18:11:21.118120 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.117905 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 18:11:21.118175 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.118125 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 18:11:21.118767 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.118752 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xnhz8\"" Jul 23 18:11:21.137222 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.137192 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74458f7f68-mhbxf"] Jul 23 18:11:21.230175 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4tr\" (UniqueName: \"kubernetes.io/projected/6c434aa8-dc24-4897-b925-d798fddc8367-kube-api-access-hm4tr\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230175 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c434aa8-dc24-4897-b925-d798fddc8367-metrics-client-ca\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230412 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-tls\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230412 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230412 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230412 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230561 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-grpc-tls\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.230561 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.230493 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.331525 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.331488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-tls\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.331685 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.331537 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.331685 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.331560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.331789 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.331689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.331789 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.331735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-grpc-tls\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.331945 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.331789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.332056 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.332027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4tr\" (UniqueName: \"kubernetes.io/projected/6c434aa8-dc24-4897-b925-d798fddc8367-kube-api-access-hm4tr\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.332125 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.332074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c434aa8-dc24-4897-b925-d798fddc8367-metrics-client-ca\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.332960 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.332930 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c434aa8-dc24-4897-b925-d798fddc8367-metrics-client-ca\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.334445 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.334415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.334640 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.334619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.334816 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.334795 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.334883 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.334859 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.334939 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.334922 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-grpc-tls\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.334986 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.334956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6c434aa8-dc24-4897-b925-d798fddc8367-secret-thanos-querier-tls\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.341204 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.341176 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4tr\" (UniqueName: \"kubernetes.io/projected/6c434aa8-dc24-4897-b925-d798fddc8367-kube-api-access-hm4tr\") pod \"thanos-querier-74458f7f68-mhbxf\" (UID: \"6c434aa8-dc24-4897-b925-d798fddc8367\") " pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.429171 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.429073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:21.463689 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.463650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnz9q" event={"ID":"8b1787e5-4cb4-45a6-be12-6e2498303cf3","Type":"ContainerStarted","Data":"53ee8dc27300682eb5ac72b8b1f914b5429818ab4057c0556dcbb7baf232379d"} Jul 23 18:11:21.464046 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.463708 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnz9q" event={"ID":"8b1787e5-4cb4-45a6-be12-6e2498303cf3","Type":"ContainerStarted","Data":"7f969c84d2bd45db9c2bffb7e90df735d16b8703c0a16999a7ca15f603cabecb"} Jul 23 18:11:21.485629 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.485432 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tnz9q" podStartSLOduration=2.553377303 podStartE2EDuration="3.485407559s" totalImagesPullingTime="862.953128ms" totalInitContainerRuntime="69.077128ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:21.484088167 +0000 UTC m=+294.102978164" watchObservedRunningTime="2026-07-23 18:11:21.485407559 +0000 UTC m=+294.104297549" Jul 23 18:11:21.572223 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:21.572187 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74458f7f68-mhbxf"] Jul 23 18:11:21.576636 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:21.576608 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c434aa8_dc24_4897_b925_d798fddc8367.slice/crio-b6419c2156a0eeab69bd47d391d8daff121501fb7c0282a4e3e966fc735d3808 WatchSource:0}: Error finding container b6419c2156a0eeab69bd47d391d8daff121501fb7c0282a4e3e966fc735d3808: Status 404 returned error can't find the container with id b6419c2156a0eeab69bd47d391d8daff121501fb7c0282a4e3e966fc735d3808 Jul 23 18:11:22.469712 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:22.469664 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"b6419c2156a0eeab69bd47d391d8daff121501fb7c0282a4e3e966fc735d3808"} Jul 23 18:11:23.270648 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.270609 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75c9d44c69-jjd2r"] Jul 23 18:11:23.274669 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.274641 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.277491 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.277456 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 18:11:23.277648 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.277458 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 18:11:23.277858 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.277751 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 18:11:23.277858 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.277832 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 18:11:23.278015 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.277848 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 18:11:23.278015 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.277894 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7hvsc\"" Jul 23 18:11:23.285151 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.284939 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 18:11:23.286851 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.286824 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75c9d44c69-jjd2r"] Jul 23 18:11:23.452350 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-secret-telemeter-client\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-telemeter-client-tls\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-federate-client-tls\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wppj\" (UniqueName: \"kubernetes.io/projected/e729b419-f82b-4aff-8fa1-7475e3231b3e-kube-api-access-2wppj\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-serving-certs-ca-bundle\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-metrics-client-ca\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.452699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.452567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553255 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-telemeter-client-tls\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-federate-client-tls\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wppj\" (UniqueName: \"kubernetes.io/projected/e729b419-f82b-4aff-8fa1-7475e3231b3e-kube-api-access-2wppj\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-serving-certs-ca-bundle\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-metrics-client-ca\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.553663 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.553469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-secret-telemeter-client\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.554367 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.554298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-metrics-client-ca\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.555085 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.555059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-serving-certs-ca-bundle\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.555764 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.555740 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729b419-f82b-4aff-8fa1-7475e3231b3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.556383 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.556330 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-secret-telemeter-client\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.556505 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.556485 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-telemeter-client-tls\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.556585 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.556485 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.557078 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.557057 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e729b419-f82b-4aff-8fa1-7475e3231b3e-federate-client-tls\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.562436 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.562411 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wppj\" (UniqueName: \"kubernetes.io/projected/e729b419-f82b-4aff-8fa1-7475e3231b3e-kube-api-access-2wppj\") pod \"telemeter-client-75c9d44c69-jjd2r\" (UID: \"e729b419-f82b-4aff-8fa1-7475e3231b3e\") " pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.587544 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.587505 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" Jul 23 18:11:23.730559 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:23.730527 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75c9d44c69-jjd2r"] Jul 23 18:11:23.734482 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:23.734450 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode729b419_f82b_4aff_8fa1_7475e3231b3e.slice/crio-3b57695fda9d96a5d521e692ee66e253875ba354c7ed9a3515a6dabb1f52ce47 WatchSource:0}: Error finding container 3b57695fda9d96a5d521e692ee66e253875ba354c7ed9a3515a6dabb1f52ce47: Status 404 returned error can't find the container with id 3b57695fda9d96a5d521e692ee66e253875ba354c7ed9a3515a6dabb1f52ce47 Jul 23 18:11:24.483405 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:24.483336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"de675227ffc24a2780512eccf79b64417a138d6796767d8cfc80bb2ea31cbf68"} Jul 23 18:11:24.483566 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:24.483456 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"79065ff1e469c89f7313e7358f6de9ba3f97f02286b12a701390aa8b0fd5db28"} Jul 23 18:11:24.483566 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:24.483502 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"484220531bbbc42bef419dbb9884f63cede6243f67078092705246c0ccecec95"} Jul 23 18:11:24.484645 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:24.484601 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" event={"ID":"e729b419-f82b-4aff-8fa1-7475e3231b3e","Type":"ContainerStarted","Data":"3b57695fda9d96a5d521e692ee66e253875ba354c7ed9a3515a6dabb1f52ce47"} Jul 23 18:11:24.511333 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:11:24.511271 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z8dkb" podUID="c52668d7-cb37-4865-886e-de9262b6f8f0" Jul 23 18:11:25.493845 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:25.493751 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"b9dbd9f8ad96d16805d642fe3aecd79864e8d8bd4c71eb44ce37289a1f27bcb6"} Jul 23 18:11:25.493845 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:25.493835 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"ad7982d7f54d0e5be0e6f23b13ccffddc9ed93a1f013a0e47d9307b65fa301bf"} Jul 23 18:11:25.494387 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:25.494068 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:25.494387 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:25.494153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" event={"ID":"6c434aa8-dc24-4897-b925-d798fddc8367","Type":"ContainerStarted","Data":"82dcdba37d8ec0631c628e9321b20830d837a06beca7268cac7a668fbcaf1049"} Jul 23 18:11:25.519446 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:25.519381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" podStartSLOduration=1.755277506 podStartE2EDuration="4.519361679s" totalImagesPullingTime="2.764084173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:25.517974502 +0000 UTC m=+298.136864488" watchObservedRunningTime="2026-07-23 18:11:25.519361679 +0000 UTC m=+298.138251664" Jul 23 18:11:26.500017 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:26.499975 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" event={"ID":"e729b419-f82b-4aff-8fa1-7475e3231b3e","Type":"ContainerStarted","Data":"3128dce9cb8649cc131b674257acadd1d7c86234a9fff9734b982d73ff3ad52a"} Jul 23 18:11:27.510939 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.510897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" event={"ID":"e729b419-f82b-4aff-8fa1-7475e3231b3e","Type":"ContainerStarted","Data":"f2d429c6387a8085e9b424d943c351325d20bf3e6419b82319a1b9d6a634108c"} Jul 23 18:11:27.511373 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.511003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" event={"ID":"e729b419-f82b-4aff-8fa1-7475e3231b3e","Type":"ContainerStarted","Data":"e2ee975fea75e589e56cb741b9fe560d0ea0d3616b7c7d41559cf2067edbed48"} Jul 23 18:11:27.535605 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.535548 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75c9d44c69-jjd2r" podStartSLOduration=1.6983800919999998 podStartE2EDuration="4.535529443s" totalImagesPullingTime="2.837149351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:27.534119928 +0000 UTC m=+300.153009913" watchObservedRunningTime="2026-07-23 18:11:27.535529443 +0000 UTC m=+300.154419431" Jul 23 18:11:27.572730 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.572690 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f98848df-mtmtz"] Jul 23 18:11:27.576070 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.576044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.578706 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.578682 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 18:11:27.578849 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.578721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vnkxw\"" Jul 23 18:11:27.578849 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.578688 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 18:11:27.578849 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.578723 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 18:11:27.578849 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.578682 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 18:11:27.579075 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.578915 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 18:11:27.579158 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.579144 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 18:11:27.579219 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.579202 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 18:11:27.584633 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.584607 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 18:11:27.586293 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.586267 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f98848df-mtmtz"] Jul 23 18:11:27.691637 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-trusted-ca-bundle\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.691637 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-config\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.691910 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-service-ca\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.691910 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-oauth-serving-cert\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.692024 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-oauth-config\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.692024 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-serving-cert\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.692024 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.691994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z72g\" (UniqueName: \"kubernetes.io/projected/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-kube-api-access-4z72g\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.697717 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.697686 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:11:27.698254 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.698231 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:11:27.703578 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.703526 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 18:11:27.792437 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-service-ca\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.792608 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-oauth-serving-cert\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.792608 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-oauth-config\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.792608 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792532 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-serving-cert\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.792608 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z72g\" (UniqueName: \"kubernetes.io/projected/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-kube-api-access-4z72g\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.792608 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-trusted-ca-bundle\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.792845 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.792611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-config\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.795559 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.795535 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 18:11:27.795676 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.795538 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 18:11:27.795829 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.795812 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 18:11:27.795907 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.795885 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 18:11:27.795961 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.795887 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 18:11:27.800222 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.800202 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 18:11:27.800739 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.800725 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 18:11:27.804238 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.804213 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-oauth-serving-cert\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.804329 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.804224 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-service-ca\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.804329 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.804292 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-config\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.804473 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.804390 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-trusted-ca-bundle\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.805994 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.805969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-serving-cert\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.806103 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.806072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-oauth-config\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.811096 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.811075 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 18:11:27.821480 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.821452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z72g\" (UniqueName: \"kubernetes.io/projected/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-kube-api-access-4z72g\") pod \"console-7f98848df-mtmtz\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:27.890511 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.890478 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vnkxw\"" Jul 23 18:11:27.897940 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:27.897909 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:28.031788 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:28.031753 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f98848df-mtmtz"] Jul 23 18:11:28.035001 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:28.034971 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cbd4bc_b893_4a67_a2d4_1848820d1d7b.slice/crio-8c73e8a2616198c079d370a9126c8c25a4ea026679e88afe1488600ff52f47a8 WatchSource:0}: Error finding container 8c73e8a2616198c079d370a9126c8c25a4ea026679e88afe1488600ff52f47a8: Status 404 returned error can't find the container with id 8c73e8a2616198c079d370a9126c8c25a4ea026679e88afe1488600ff52f47a8 Jul 23 18:11:28.452986 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:28.452953 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j6kj4" Jul 23 18:11:28.519966 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:28.519762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98848df-mtmtz" event={"ID":"00cbd4bc-b893-4a67-a2d4-1848820d1d7b","Type":"ContainerStarted","Data":"8c73e8a2616198c079d370a9126c8c25a4ea026679e88afe1488600ff52f47a8"} Jul 23 18:11:29.754808 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:29.754774 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:11:31.507595 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:31.507566 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74458f7f68-mhbxf" Jul 23 18:11:31.535007 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:31.534968 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98848df-mtmtz" event={"ID":"00cbd4bc-b893-4a67-a2d4-1848820d1d7b","Type":"ContainerStarted","Data":"e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21"} Jul 23 18:11:31.558133 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:31.558080 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f98848df-mtmtz" podStartSLOduration=1.69218973 podStartE2EDuration="4.558057562s" totalImagesPullingTime="2.865867832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:31.556579479 +0000 UTC m=+304.175469464" watchObservedRunningTime="2026-07-23 18:11:31.558057562 +0000 UTC m=+304.176947546" Jul 23 18:11:34.769966 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:34.769897 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-657985476d-4nnxx" podUID="17a11868-cc95-43bc-9607-ce42c1130fdf" containerName="registry" containerID="cri-o://89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000" gracePeriod=30 Jul 23 18:11:35.013595 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.013568 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:11:35.058385 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058332 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-certificates\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058590 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058407 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp4kh\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-kube-api-access-pp4kh\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058590 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058426 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17a11868-cc95-43bc-9607-ce42c1130fdf-ca-trust-extracted\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058590 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058524 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-installation-pull-secrets\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058590 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058561 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-bound-sa-token\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058590 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058590 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-image-registry-private-configuration\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058923 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058621 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058923 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058640 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-trusted-ca\") pod \"17a11868-cc95-43bc-9607-ce42c1130fdf\" (UID: \"17a11868-cc95-43bc-9607-ce42c1130fdf\") " Jul 23 18:11:35.058923 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058777 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:11:35.058923 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.058894 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-certificates\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.059360 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.059302 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:11:35.060936 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.060908 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:11:35.061086 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.061068 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-kube-api-access-pp4kh" (OuterVolumeSpecName: "kube-api-access-pp4kh") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "kube-api-access-pp4kh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:11:35.061148 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.061129 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:11:35.061242 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.061221 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:11:35.061333 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.061305 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:11:35.066888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.066865 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17a11868-cc95-43bc-9607-ce42c1130fdf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "17a11868-cc95-43bc-9607-ce42c1130fdf" (UID: "17a11868-cc95-43bc-9607-ce42c1130fdf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:11:35.159699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159654 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp4kh\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-kube-api-access-pp4kh\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.159699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159691 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17a11868-cc95-43bc-9607-ce42c1130fdf-ca-trust-extracted\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.159699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159701 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-installation-pull-secrets\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.159699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159710 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-bound-sa-token\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.159947 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159720 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17a11868-cc95-43bc-9607-ce42c1130fdf-image-registry-private-configuration\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.159947 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159729 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17a11868-cc95-43bc-9607-ce42c1130fdf-registry-tls\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.159947 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.159737 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a11868-cc95-43bc-9607-ce42c1130fdf-trusted-ca\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:11:35.558717 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.558683 2572 generic.go:356] "Generic (PLEG): container finished" podID="17a11868-cc95-43bc-9607-ce42c1130fdf" containerID="89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000" exitCode=0 Jul 23 18:11:35.558877 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.558727 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-657985476d-4nnxx" Jul 23 18:11:35.558877 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.558741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-657985476d-4nnxx" event={"ID":"17a11868-cc95-43bc-9607-ce42c1130fdf","Type":"ContainerDied","Data":"89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000"} Jul 23 18:11:35.558877 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.558781 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-657985476d-4nnxx" event={"ID":"17a11868-cc95-43bc-9607-ce42c1130fdf","Type":"ContainerDied","Data":"44994a3a55d5d758bcf43ba7d07af86400528eac52a98209647aba3f65fe3068"} Jul 23 18:11:35.558877 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.558800 2572 scope.go:117] "RemoveContainer" containerID="89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000" Jul 23 18:11:35.567912 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.567892 2572 scope.go:117] "RemoveContainer" containerID="89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000" Jul 23 18:11:35.568243 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:11:35.568221 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000\": container with ID starting with 89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000 not found: ID does not exist" containerID="89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000" Jul 23 18:11:35.568301 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.568254 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000"} err="failed to get container status \"89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000\": rpc error: code = NotFound desc = could not find container \"89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000\": container with ID starting with 89be8f7d7335336ba1bbadc4e0a97269833b17e0ff4e0764ee0cb7c63b9c3000 not found: ID does not exist" Jul 23 18:11:35.581575 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.581543 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-657985476d-4nnxx"] Jul 23 18:11:35.587431 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.587399 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-657985476d-4nnxx"] Jul 23 18:11:35.658086 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.658050 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f98848df-mtmtz"] Jul 23 18:11:35.692654 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.692620 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78fbd66bbf-r44p4"] Jul 23 18:11:35.692925 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.692914 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a11868-cc95-43bc-9607-ce42c1130fdf" containerName="registry" Jul 23 18:11:35.692967 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.692927 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a11868-cc95-43bc-9607-ce42c1130fdf" containerName="registry" Jul 23 18:11:35.693000 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.692976 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="17a11868-cc95-43bc-9607-ce42c1130fdf" containerName="registry" Jul 23 18:11:35.700009 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.699983 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.708285 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.708253 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fbd66bbf-r44p4"] Jul 23 18:11:35.763235 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77l86\" (UniqueName: \"kubernetes.io/projected/dc13ff86-3250-4c6b-998d-15282019885f-kube-api-access-77l86\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.763235 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763237 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-serving-cert\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.763491 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-oauth-config\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.763491 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-trusted-ca-bundle\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.763491 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763405 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-console-config\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.763491 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-service-ca\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.763491 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.763479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-oauth-serving-cert\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864008 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.863916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-trusted-ca-bundle\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864008 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.863968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-console-config\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864008 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-service-ca\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864610 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-oauth-serving-cert\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864610 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77l86\" (UniqueName: \"kubernetes.io/projected/dc13ff86-3250-4c6b-998d-15282019885f-kube-api-access-77l86\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864610 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-serving-cert\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864610 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864107 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-oauth-config\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864921 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-console-config\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.864944 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864930 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-service-ca\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.865083 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.864976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-oauth-serving-cert\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.865140 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.865091 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-trusted-ca-bundle\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.866627 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.866603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-serving-cert\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.866733 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.866690 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-oauth-config\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:35.874119 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:35.874095 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77l86\" (UniqueName: \"kubernetes.io/projected/dc13ff86-3250-4c6b-998d-15282019885f-kube-api-access-77l86\") pod \"console-78fbd66bbf-r44p4\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:36.010390 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:36.010330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:36.169953 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:36.169920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fbd66bbf-r44p4"] Jul 23 18:11:36.172957 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:11:36.172928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc13ff86_3250_4c6b_998d_15282019885f.slice/crio-100a42013749426da5da99686cfafff2297f6e96a16df59f98321d581ca342f5 WatchSource:0}: Error finding container 100a42013749426da5da99686cfafff2297f6e96a16df59f98321d581ca342f5: Status 404 returned error can't find the container with id 100a42013749426da5da99686cfafff2297f6e96a16df59f98321d581ca342f5 Jul 23 18:11:36.516233 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:36.516162 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17a11868-cc95-43bc-9607-ce42c1130fdf" path="/var/lib/kubelet/pods/17a11868-cc95-43bc-9607-ce42c1130fdf/volumes" Jul 23 18:11:36.563980 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:36.563944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fbd66bbf-r44p4" event={"ID":"dc13ff86-3250-4c6b-998d-15282019885f","Type":"ContainerStarted","Data":"bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c"} Jul 23 18:11:36.564165 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:36.563998 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fbd66bbf-r44p4" event={"ID":"dc13ff86-3250-4c6b-998d-15282019885f","Type":"ContainerStarted","Data":"100a42013749426da5da99686cfafff2297f6e96a16df59f98321d581ca342f5"} Jul 23 18:11:36.585492 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:36.585426 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78fbd66bbf-r44p4" podStartSLOduration=1.585409811 podStartE2EDuration="1.585409811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:36.585031801 +0000 UTC m=+309.203921787" watchObservedRunningTime="2026-07-23 18:11:36.585409811 +0000 UTC m=+309.204299796" Jul 23 18:11:37.510930 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:37.510892 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:11:37.898455 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:37.898413 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:11:46.011092 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:46.011049 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:46.011654 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:46.011121 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:46.015903 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:46.015877 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:11:46.608490 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:11:46.608450 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:12:00.657882 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:00.657846 2572 generic.go:356] "Generic (PLEG): container finished" podID="e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec" containerID="30f05a396de7685e1b4f8f5b3417bca4b1a5a5d53610e73bbd57bb5bcfdd17b2" exitCode=0 Jul 23 18:12:00.658382 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:00.657919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" event={"ID":"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec","Type":"ContainerDied","Data":"30f05a396de7685e1b4f8f5b3417bca4b1a5a5d53610e73bbd57bb5bcfdd17b2"} Jul 23 18:12:00.658382 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:00.658320 2572 scope.go:117] "RemoveContainer" containerID="30f05a396de7685e1b4f8f5b3417bca4b1a5a5d53610e73bbd57bb5bcfdd17b2" Jul 23 18:12:00.678709 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:00.678674 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f98848df-mtmtz" podUID="00cbd4bc-b893-4a67-a2d4-1848820d1d7b" containerName="console" containerID="cri-o://e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21" gracePeriod=15 Jul 23 18:12:00.924457 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:00.924431 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:12:01.000987 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.000949 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-config\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.000987 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.000994 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-oauth-config\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.001232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001017 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-serving-cert\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.001232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001041 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-service-ca\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.001232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001086 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-oauth-serving-cert\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.001232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001118 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z72g\" (UniqueName: \"kubernetes.io/projected/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-kube-api-access-4z72g\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.001232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001146 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-trusted-ca-bundle\") pod \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\" (UID: \"00cbd4bc-b893-4a67-a2d4-1848820d1d7b\") " Jul 23 18:12:01.001500 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001417 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-config" (OuterVolumeSpecName: "console-config") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:01.001605 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001573 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:01.001739 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001714 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:01.001902 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.001874 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:01.003460 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.003432 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:01.003558 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.003531 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:01.003558 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.003528 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-kube-api-access-4z72g" (OuterVolumeSpecName: "kube-api-access-4z72g") pod "00cbd4bc-b893-4a67-a2d4-1848820d1d7b" (UID: "00cbd4bc-b893-4a67-a2d4-1848820d1d7b"). InnerVolumeSpecName "kube-api-access-4z72g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:12:01.101855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101816 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-config\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.101855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101849 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-oauth-config\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.101855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101864 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-console-serving-cert\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.102087 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101877 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-service-ca\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.102087 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101889 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-oauth-serving-cert\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.102087 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101902 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z72g\" (UniqueName: \"kubernetes.io/projected/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-kube-api-access-4z72g\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.102087 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.101914 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cbd4bc-b893-4a67-a2d4-1848820d1d7b-trusted-ca-bundle\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:12:01.663217 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.663177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lv7wp" event={"ID":"e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec","Type":"ContainerStarted","Data":"15dbb6d4ef05a76e1055ec019068f9839ff51b5e9d32f0852be0e4efad67afad"} Jul 23 18:12:01.664505 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.664475 2572 generic.go:356] "Generic (PLEG): container finished" podID="00cbd4bc-b893-4a67-a2d4-1848820d1d7b" containerID="e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21" exitCode=0 Jul 23 18:12:01.664505 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.664515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98848df-mtmtz" event={"ID":"00cbd4bc-b893-4a67-a2d4-1848820d1d7b","Type":"ContainerDied","Data":"e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21"} Jul 23 18:12:01.664709 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.664524 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98848df-mtmtz" Jul 23 18:12:01.664709 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.664554 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98848df-mtmtz" event={"ID":"00cbd4bc-b893-4a67-a2d4-1848820d1d7b","Type":"ContainerDied","Data":"8c73e8a2616198c079d370a9126c8c25a4ea026679e88afe1488600ff52f47a8"} Jul 23 18:12:01.664709 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.664580 2572 scope.go:117] "RemoveContainer" containerID="e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21" Jul 23 18:12:01.673974 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.673955 2572 scope.go:117] "RemoveContainer" containerID="e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21" Jul 23 18:12:01.674274 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:12:01.674256 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21\": container with ID starting with e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21 not found: ID does not exist" containerID="e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21" Jul 23 18:12:01.674328 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.674287 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21"} err="failed to get container status \"e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21\": rpc error: code = NotFound desc = could not find container \"e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21\": container with ID starting with e100d39d9c8e41df40b40d51e90d83e0119da3b9b4d15963dd6ecee501d2ac21 not found: ID does not exist" Jul 23 18:12:01.694987 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.694954 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f98848df-mtmtz"] Jul 23 18:12:01.700849 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:01.700807 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f98848df-mtmtz"] Jul 23 18:12:02.515735 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:02.515698 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00cbd4bc-b893-4a67-a2d4-1848820d1d7b" path="/var/lib/kubelet/pods/00cbd4bc-b893-4a67-a2d4-1848820d1d7b/volumes" Jul 23 18:12:16.722674 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:16.722636 2572 generic.go:356] "Generic (PLEG): container finished" podID="33d5cb9a-1941-4860-89e0-3bc19b7d56a7" containerID="72d05737a7a953d167ef4707f5dd66120dc0c2b595c20a35a178bb5ceb791c8c" exitCode=0 Jul 23 18:12:16.723225 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:16.722718 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" event={"ID":"33d5cb9a-1941-4860-89e0-3bc19b7d56a7","Type":"ContainerDied","Data":"72d05737a7a953d167ef4707f5dd66120dc0c2b595c20a35a178bb5ceb791c8c"} Jul 23 18:12:16.723225 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:16.723164 2572 scope.go:117] "RemoveContainer" containerID="72d05737a7a953d167ef4707f5dd66120dc0c2b595c20a35a178bb5ceb791c8c" Jul 23 18:12:17.728618 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:17.728582 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tp2r4" event={"ID":"33d5cb9a-1941-4860-89e0-3bc19b7d56a7","Type":"ContainerStarted","Data":"f8e857dfe7d541a409823b0e6596cd968cd53490ddd227e6b895efbcf978fa20"} Jul 23 18:12:41.758982 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:41.758934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:12:41.761369 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:41.761328 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c52668d7-cb37-4865-886e-de9262b6f8f0-metrics-certs\") pod \"network-metrics-daemon-z8dkb\" (UID: \"c52668d7-cb37-4865-886e-de9262b6f8f0\") " pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:12:42.015220 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:42.015135 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqn6\"" Jul 23 18:12:42.022576 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:42.022552 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8dkb" Jul 23 18:12:42.154900 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:42.154862 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8dkb"] Jul 23 18:12:42.157835 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:12:42.157794 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52668d7_cb37_4865_886e_de9262b6f8f0.slice/crio-0ca8dd6f1fb76a2e528b262777bda4389112d635fe98171106becf8f8f910e19 WatchSource:0}: Error finding container 0ca8dd6f1fb76a2e528b262777bda4389112d635fe98171106becf8f8f910e19: Status 404 returned error can't find the container with id 0ca8dd6f1fb76a2e528b262777bda4389112d635fe98171106becf8f8f910e19 Jul 23 18:12:42.160414 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:42.160391 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:12:42.832863 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:42.832823 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8dkb" event={"ID":"c52668d7-cb37-4865-886e-de9262b6f8f0","Type":"ContainerStarted","Data":"0ca8dd6f1fb76a2e528b262777bda4389112d635fe98171106becf8f8f910e19"} Jul 23 18:12:43.840746 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:43.840712 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8dkb" event={"ID":"c52668d7-cb37-4865-886e-de9262b6f8f0","Type":"ContainerStarted","Data":"780357e2f9de6de76b8ceaa03363e9fc46b30b6f6fc738999a3ae41f7987537a"} Jul 23 18:12:43.841123 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:43.840761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8dkb" event={"ID":"c52668d7-cb37-4865-886e-de9262b6f8f0","Type":"ContainerStarted","Data":"0acde8fb75c662cfaa3afd49f1c09fd10137f3e243adc18c28dc4006a383cfe7"} Jul 23 18:12:43.858879 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:43.858821 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z8dkb" podStartSLOduration=373.814162634 podStartE2EDuration="6m14.858801585s" totalImagesPullingTime="1.044638951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:43.856704269 +0000 UTC m=+376.475594254" watchObservedRunningTime="2026-07-23 18:12:43.858801585 +0000 UTC m=+376.477691570" Jul 23 18:12:55.430327 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.430293 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8f49b47d-9tpfw"] Jul 23 18:12:55.430771 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.430601 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cbd4bc-b893-4a67-a2d4-1848820d1d7b" containerName="console" Jul 23 18:12:55.430771 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.430611 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cbd4bc-b893-4a67-a2d4-1848820d1d7b" containerName="console" Jul 23 18:12:55.430771 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.430672 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="00cbd4bc-b893-4a67-a2d4-1848820d1d7b" containerName="console" Jul 23 18:12:55.434931 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.434913 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.446789 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.446758 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8f49b47d-9tpfw"] Jul 23 18:12:55.574039 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.573994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-oauth-config\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.574039 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.574039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-serving-cert\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.574248 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.574061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-service-ca\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.574248 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.574149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-trusted-ca-bundle\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.574248 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.574186 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-config\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.574248 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.574208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ms8\" (UniqueName: \"kubernetes.io/projected/aedd4077-ff1b-469c-a5eb-645ba01133f6-kube-api-access-m7ms8\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.574411 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.574279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-oauth-serving-cert\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675254 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-oauth-config\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675254 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-serving-cert\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675529 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-service-ca\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675529 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675313 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-trusted-ca-bundle\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675529 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-config\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675677 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ms8\" (UniqueName: \"kubernetes.io/projected/aedd4077-ff1b-469c-a5eb-645ba01133f6-kube-api-access-m7ms8\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.675677 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.675591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-oauth-serving-cert\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.676191 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.676161 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-service-ca\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.676275 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.676200 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-config\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.676315 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.676302 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-trusted-ca-bundle\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.676378 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.676328 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-oauth-serving-cert\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.677781 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.677762 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-oauth-config\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.677898 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.677880 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-serving-cert\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.684050 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.683983 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ms8\" (UniqueName: \"kubernetes.io/projected/aedd4077-ff1b-469c-a5eb-645ba01133f6-kube-api-access-m7ms8\") pod \"console-5f8f49b47d-9tpfw\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.743527 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.743484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:12:55.876837 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.876803 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8f49b47d-9tpfw"] Jul 23 18:12:55.880065 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:12:55.880032 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedd4077_ff1b_469c_a5eb_645ba01133f6.slice/crio-896cb7ecbcccff7e31c4d1f04992f94606beb0f4a5feda8c2cebe7aa02bf53e4 WatchSource:0}: Error finding container 896cb7ecbcccff7e31c4d1f04992f94606beb0f4a5feda8c2cebe7aa02bf53e4: Status 404 returned error can't find the container with id 896cb7ecbcccff7e31c4d1f04992f94606beb0f4a5feda8c2cebe7aa02bf53e4 Jul 23 18:12:55.888392 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:55.888365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8f49b47d-9tpfw" event={"ID":"aedd4077-ff1b-469c-a5eb-645ba01133f6","Type":"ContainerStarted","Data":"896cb7ecbcccff7e31c4d1f04992f94606beb0f4a5feda8c2cebe7aa02bf53e4"} Jul 23 18:12:56.893455 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:56.893417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8f49b47d-9tpfw" event={"ID":"aedd4077-ff1b-469c-a5eb-645ba01133f6","Type":"ContainerStarted","Data":"2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a"} Jul 23 18:12:56.912782 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:12:56.912729 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8f49b47d-9tpfw" podStartSLOduration=1.912712103 podStartE2EDuration="1.912712103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:56.91125964 +0000 UTC m=+389.530149617" watchObservedRunningTime="2026-07-23 18:12:56.912712103 +0000 UTC m=+389.531602088" Jul 23 18:13:05.743777 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:05.743721 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:13:05.743777 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:05.743792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:13:05.748705 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:05.748681 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:13:05.933261 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:05.933233 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:13:05.981536 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:05.981501 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78fbd66bbf-r44p4"] Jul 23 18:13:31.008093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.008050 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78fbd66bbf-r44p4" podUID="dc13ff86-3250-4c6b-998d-15282019885f" containerName="console" containerID="cri-o://bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c" gracePeriod=15 Jul 23 18:13:31.247935 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.247903 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:13:31.378664 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378623 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-trusted-ca-bundle\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.378838 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378727 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77l86\" (UniqueName: \"kubernetes.io/projected/dc13ff86-3250-4c6b-998d-15282019885f-kube-api-access-77l86\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.378838 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378774 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-oauth-serving-cert\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.378838 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378811 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-service-ca\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.378975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378861 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-console-config\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.378975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378897 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-oauth-config\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.378975 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.378923 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-serving-cert\") pod \"dc13ff86-3250-4c6b-998d-15282019885f\" (UID: \"dc13ff86-3250-4c6b-998d-15282019885f\") " Jul 23 18:13:31.379118 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.379032 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:13:31.379323 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.379302 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-trusted-ca-bundle\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:31.379323 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.379306 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:13:31.379492 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.379395 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-console-config" (OuterVolumeSpecName: "console-config") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:13:31.379492 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.379461 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:13:31.381180 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.381148 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:13:31.381271 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.381181 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:13:31.381271 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.381202 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc13ff86-3250-4c6b-998d-15282019885f-kube-api-access-77l86" (OuterVolumeSpecName: "kube-api-access-77l86") pod "dc13ff86-3250-4c6b-998d-15282019885f" (UID: "dc13ff86-3250-4c6b-998d-15282019885f"). InnerVolumeSpecName "kube-api-access-77l86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:13:31.480274 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.480237 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77l86\" (UniqueName: \"kubernetes.io/projected/dc13ff86-3250-4c6b-998d-15282019885f-kube-api-access-77l86\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:31.480274 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.480271 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-oauth-serving-cert\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:31.480274 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.480281 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-service-ca\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:31.480559 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.480290 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc13ff86-3250-4c6b-998d-15282019885f-console-config\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:31.480559 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.480300 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-oauth-config\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:31.480559 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:31.480310 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc13ff86-3250-4c6b-998d-15282019885f-console-serving-cert\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:13:32.028865 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.028833 2572 generic.go:356] "Generic (PLEG): container finished" podID="dc13ff86-3250-4c6b-998d-15282019885f" containerID="bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c" exitCode=0 Jul 23 18:13:32.029268 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.028880 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fbd66bbf-r44p4" Jul 23 18:13:32.029268 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.028928 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fbd66bbf-r44p4" event={"ID":"dc13ff86-3250-4c6b-998d-15282019885f","Type":"ContainerDied","Data":"bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c"} Jul 23 18:13:32.029268 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.028977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fbd66bbf-r44p4" event={"ID":"dc13ff86-3250-4c6b-998d-15282019885f","Type":"ContainerDied","Data":"100a42013749426da5da99686cfafff2297f6e96a16df59f98321d581ca342f5"} Jul 23 18:13:32.029268 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.028998 2572 scope.go:117] "RemoveContainer" containerID="bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c" Jul 23 18:13:32.037766 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.037748 2572 scope.go:117] "RemoveContainer" containerID="bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c" Jul 23 18:13:32.038064 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:13:32.038044 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c\": container with ID starting with bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c not found: ID does not exist" containerID="bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c" Jul 23 18:13:32.038112 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.038075 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c"} err="failed to get container status \"bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c\": rpc error: code = NotFound desc = could not find container \"bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c\": container with ID starting with bd673793203986c78bebb761e541ab1f7603d192027ff69b3613dae5aecea70c not found: ID does not exist" Jul 23 18:13:32.051545 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.051502 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78fbd66bbf-r44p4"] Jul 23 18:13:32.055365 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.055310 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78fbd66bbf-r44p4"] Jul 23 18:13:32.515804 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:32.515768 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc13ff86-3250-4c6b-998d-15282019885f" path="/var/lib/kubelet/pods/dc13ff86-3250-4c6b-998d-15282019885f/volumes" Jul 23 18:13:44.095752 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.095716 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj"] Jul 23 18:13:44.096138 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.096036 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc13ff86-3250-4c6b-998d-15282019885f" containerName="console" Jul 23 18:13:44.096138 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.096047 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc13ff86-3250-4c6b-998d-15282019885f" containerName="console" Jul 23 18:13:44.096138 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.096115 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc13ff86-3250-4c6b-998d-15282019885f" containerName="console" Jul 23 18:13:44.100594 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.100576 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.103416 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.103394 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 18:13:44.103536 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.103394 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 18:13:44.103536 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.103473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s5mrk\"" Jul 23 18:13:44.109431 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.109406 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj"] Jul 23 18:13:44.194726 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.194668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.194921 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.194784 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4hz\" (UniqueName: \"kubernetes.io/projected/113ab4f4-6e51-417a-9323-45f155a777be-kube-api-access-lz4hz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.194921 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.194846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.296056 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.296024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.296253 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.296092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4hz\" (UniqueName: \"kubernetes.io/projected/113ab4f4-6e51-417a-9323-45f155a777be-kube-api-access-lz4hz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.296253 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.296129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.296504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.296481 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.296586 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.296529 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.304609 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.304580 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4hz\" (UniqueName: \"kubernetes.io/projected/113ab4f4-6e51-417a-9323-45f155a777be-kube-api-access-lz4hz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.410689 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.410580 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:13:44.544449 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:44.544416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj"] Jul 23 18:13:44.547570 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:13:44.547540 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113ab4f4_6e51_417a_9323_45f155a777be.slice/crio-6ec0bc57bd8e519c09c85e5d261e31ff896e832503d374b0e4344334ccfa3ad4 WatchSource:0}: Error finding container 6ec0bc57bd8e519c09c85e5d261e31ff896e832503d374b0e4344334ccfa3ad4: Status 404 returned error can't find the container with id 6ec0bc57bd8e519c09c85e5d261e31ff896e832503d374b0e4344334ccfa3ad4 Jul 23 18:13:45.084266 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:45.084225 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" event={"ID":"113ab4f4-6e51-417a-9323-45f155a777be","Type":"ContainerStarted","Data":"6ec0bc57bd8e519c09c85e5d261e31ff896e832503d374b0e4344334ccfa3ad4"} Jul 23 18:13:52.115853 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:52.115811 2572 generic.go:356] "Generic (PLEG): container finished" podID="113ab4f4-6e51-417a-9323-45f155a777be" containerID="c34c4dbc4ecfda79c3ea65fabb2c6f23297470936b355ff7ecc8199377a9215f" exitCode=0 Jul 23 18:13:52.116227 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:52.115909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" event={"ID":"113ab4f4-6e51-417a-9323-45f155a777be","Type":"ContainerDied","Data":"c34c4dbc4ecfda79c3ea65fabb2c6f23297470936b355ff7ecc8199377a9215f"} Jul 23 18:13:55.129832 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:55.129796 2572 generic.go:356] "Generic (PLEG): container finished" podID="113ab4f4-6e51-417a-9323-45f155a777be" containerID="9c3e4e19df26438ae0f307ccf0fb2065c85c8c72d4a1a6cc7585851886fa2b95" exitCode=0 Jul 23 18:13:55.130210 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:13:55.129862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" event={"ID":"113ab4f4-6e51-417a-9323-45f155a777be","Type":"ContainerDied","Data":"9c3e4e19df26438ae0f307ccf0fb2065c85c8c72d4a1a6cc7585851886fa2b95"} Jul 23 18:14:02.163091 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:02.163050 2572 generic.go:356] "Generic (PLEG): container finished" podID="113ab4f4-6e51-417a-9323-45f155a777be" containerID="43d015e00858381a4d70b7aa4265259708eb862f86b3bd971edd21db31c25712" exitCode=0 Jul 23 18:14:02.163565 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:02.163128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" event={"ID":"113ab4f4-6e51-417a-9323-45f155a777be","Type":"ContainerDied","Data":"43d015e00858381a4d70b7aa4265259708eb862f86b3bd971edd21db31c25712"} Jul 23 18:14:03.294711 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.294685 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:14:03.347878 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.347845 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-bundle\") pod \"113ab4f4-6e51-417a-9323-45f155a777be\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " Jul 23 18:14:03.348058 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.347900 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz4hz\" (UniqueName: \"kubernetes.io/projected/113ab4f4-6e51-417a-9323-45f155a777be-kube-api-access-lz4hz\") pod \"113ab4f4-6e51-417a-9323-45f155a777be\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " Jul 23 18:14:03.348058 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.347937 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-util\") pod \"113ab4f4-6e51-417a-9323-45f155a777be\" (UID: \"113ab4f4-6e51-417a-9323-45f155a777be\") " Jul 23 18:14:03.348755 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.348725 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-bundle" (OuterVolumeSpecName: "bundle") pod "113ab4f4-6e51-417a-9323-45f155a777be" (UID: "113ab4f4-6e51-417a-9323-45f155a777be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:14:03.350126 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.350100 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113ab4f4-6e51-417a-9323-45f155a777be-kube-api-access-lz4hz" (OuterVolumeSpecName: "kube-api-access-lz4hz") pod "113ab4f4-6e51-417a-9323-45f155a777be" (UID: "113ab4f4-6e51-417a-9323-45f155a777be"). InnerVolumeSpecName "kube-api-access-lz4hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:14:03.352326 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.352294 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-util" (OuterVolumeSpecName: "util") pod "113ab4f4-6e51-417a-9323-45f155a777be" (UID: "113ab4f4-6e51-417a-9323-45f155a777be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:14:03.448726 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.448637 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz4hz\" (UniqueName: \"kubernetes.io/projected/113ab4f4-6e51-417a-9323-45f155a777be-kube-api-access-lz4hz\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:14:03.448726 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.448670 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-util\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:14:03.448726 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:03.448679 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/113ab4f4-6e51-417a-9323-45f155a777be-bundle\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:14:04.171898 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:04.171853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" event={"ID":"113ab4f4-6e51-417a-9323-45f155a777be","Type":"ContainerDied","Data":"6ec0bc57bd8e519c09c85e5d261e31ff896e832503d374b0e4344334ccfa3ad4"} Jul 23 18:14:04.171898 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:04.171895 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lxsmj" Jul 23 18:14:04.172100 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:04.171898 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ec0bc57bd8e519c09c85e5d261e31ff896e832503d374b0e4344334ccfa3ad4" Jul 23 18:14:12.469184 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469150 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d"] Jul 23 18:14:12.469713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469602 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="pull" Jul 23 18:14:12.469713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469622 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="pull" Jul 23 18:14:12.469713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469643 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="extract" Jul 23 18:14:12.469713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469651 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="extract" Jul 23 18:14:12.469713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469667 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="util" Jul 23 18:14:12.469713 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469674 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="util" Jul 23 18:14:12.469994 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.469749 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="113ab4f4-6e51-417a-9323-45f155a777be" containerName="extract" Jul 23 18:14:12.474290 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.474267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.477412 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.477390 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jrv5b\"" Jul 23 18:14:12.477563 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.477389 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:14:12.477747 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.477730 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 23 18:14:12.484417 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.484393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d"] Jul 23 18:14:12.506680 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.506640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fsm4\" (UniqueName: \"kubernetes.io/projected/465d6509-0a31-4de2-867a-7db5ba9721c6-kube-api-access-5fsm4\") pod \"cert-manager-operator-controller-manager-56b4598547-ncf6d\" (UID: \"465d6509-0a31-4de2-867a-7db5ba9721c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.506843 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.506733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/465d6509-0a31-4de2-867a-7db5ba9721c6-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-ncf6d\" (UID: \"465d6509-0a31-4de2-867a-7db5ba9721c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.607185 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.607146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fsm4\" (UniqueName: \"kubernetes.io/projected/465d6509-0a31-4de2-867a-7db5ba9721c6-kube-api-access-5fsm4\") pod \"cert-manager-operator-controller-manager-56b4598547-ncf6d\" (UID: \"465d6509-0a31-4de2-867a-7db5ba9721c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.607382 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.607263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/465d6509-0a31-4de2-867a-7db5ba9721c6-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-ncf6d\" (UID: \"465d6509-0a31-4de2-867a-7db5ba9721c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.607746 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.607723 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/465d6509-0a31-4de2-867a-7db5ba9721c6-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-ncf6d\" (UID: \"465d6509-0a31-4de2-867a-7db5ba9721c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.620460 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.620429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fsm4\" (UniqueName: \"kubernetes.io/projected/465d6509-0a31-4de2-867a-7db5ba9721c6-kube-api-access-5fsm4\") pod \"cert-manager-operator-controller-manager-56b4598547-ncf6d\" (UID: \"465d6509-0a31-4de2-867a-7db5ba9721c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.784437 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.784316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" Jul 23 18:14:12.921719 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:12.921684 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d"] Jul 23 18:14:12.925443 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:14:12.925406 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465d6509_0a31_4de2_867a_7db5ba9721c6.slice/crio-fae9b8e9c6718bcac1abce95d77e7ceb9d96e0afec4479d1cb0fee1b9bbccb3b WatchSource:0}: Error finding container fae9b8e9c6718bcac1abce95d77e7ceb9d96e0afec4479d1cb0fee1b9bbccb3b: Status 404 returned error can't find the container with id fae9b8e9c6718bcac1abce95d77e7ceb9d96e0afec4479d1cb0fee1b9bbccb3b Jul 23 18:14:13.208409 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:13.208372 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" event={"ID":"465d6509-0a31-4de2-867a-7db5ba9721c6","Type":"ContainerStarted","Data":"fae9b8e9c6718bcac1abce95d77e7ceb9d96e0afec4479d1cb0fee1b9bbccb3b"} Jul 23 18:14:15.220680 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:15.220615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" event={"ID":"465d6509-0a31-4de2-867a-7db5ba9721c6","Type":"ContainerStarted","Data":"941d92e17d9a88efe05e663730262f803b6b090baa6741ad76b8ce6251427dea"} Jul 23 18:14:15.247820 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:15.247490 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-ncf6d" podStartSLOduration=1.601083737 podStartE2EDuration="3.24746771s" totalImagesPullingTime="1.646383973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:14:15.244014053 +0000 UTC m=+467.862904038" watchObservedRunningTime="2026-07-23 18:14:15.24746771 +0000 UTC m=+467.866357696" Jul 23 18:14:16.492261 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.492218 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xnmcc"] Jul 23 18:14:16.495836 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.495811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.498682 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.498656 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 18:14:16.499775 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.499756 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 18:14:16.499891 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.499776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vddzh\"" Jul 23 18:14:16.517697 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.517664 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xnmcc"] Jul 23 18:14:16.540442 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.540401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6scb6\" (UniqueName: \"kubernetes.io/projected/39def6a1-7938-4e8f-8c5c-3256684d5967-kube-api-access-6scb6\") pod \"cert-manager-webhook-6486ffd997-xnmcc\" (UID: \"39def6a1-7938-4e8f-8c5c-3256684d5967\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.540621 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.540453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39def6a1-7938-4e8f-8c5c-3256684d5967-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xnmcc\" (UID: \"39def6a1-7938-4e8f-8c5c-3256684d5967\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.641187 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.641143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6scb6\" (UniqueName: \"kubernetes.io/projected/39def6a1-7938-4e8f-8c5c-3256684d5967-kube-api-access-6scb6\") pod \"cert-manager-webhook-6486ffd997-xnmcc\" (UID: \"39def6a1-7938-4e8f-8c5c-3256684d5967\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.641187 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.641193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39def6a1-7938-4e8f-8c5c-3256684d5967-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xnmcc\" (UID: \"39def6a1-7938-4e8f-8c5c-3256684d5967\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.649901 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.649876 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39def6a1-7938-4e8f-8c5c-3256684d5967-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xnmcc\" (UID: \"39def6a1-7938-4e8f-8c5c-3256684d5967\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.650067 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.650047 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6scb6\" (UniqueName: \"kubernetes.io/projected/39def6a1-7938-4e8f-8c5c-3256684d5967-kube-api-access-6scb6\") pod \"cert-manager-webhook-6486ffd997-xnmcc\" (UID: \"39def6a1-7938-4e8f-8c5c-3256684d5967\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.805856 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.805825 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:16.944117 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:16.944094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xnmcc"] Jul 23 18:14:16.946772 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:14:16.946742 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39def6a1_7938_4e8f_8c5c_3256684d5967.slice/crio-ef40f058268a3c4d60c90b1cf02c1318cce93f45d70f47feecce2992386910ce WatchSource:0}: Error finding container ef40f058268a3c4d60c90b1cf02c1318cce93f45d70f47feecce2992386910ce: Status 404 returned error can't find the container with id ef40f058268a3c4d60c90b1cf02c1318cce93f45d70f47feecce2992386910ce Jul 23 18:14:17.232098 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:17.232007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" event={"ID":"39def6a1-7938-4e8f-8c5c-3256684d5967","Type":"ContainerStarted","Data":"ef40f058268a3c4d60c90b1cf02c1318cce93f45d70f47feecce2992386910ce"} Jul 23 18:14:20.249644 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:20.249552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" event={"ID":"39def6a1-7938-4e8f-8c5c-3256684d5967","Type":"ContainerStarted","Data":"edaf302ff1476415e9dfcb54ebb8f87968d4e6ece6d90dc706fdc260da6a6122"} Jul 23 18:14:20.249644 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:20.249613 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:20.266764 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:20.266707 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" podStartSLOduration=1.2763769200000001 podStartE2EDuration="4.26668564s" totalImagesPullingTime="2.99030872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:14:20.26642479 +0000 UTC m=+472.885314777" watchObservedRunningTime="2026-07-23 18:14:20.26668564 +0000 UTC m=+472.885575627" Jul 23 18:14:25.793218 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.793186 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nmbwk"] Jul 23 18:14:25.796620 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.796597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:25.799268 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.799250 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6xgj2\"" Jul 23 18:14:25.806252 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.806226 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nmbwk"] Jul 23 18:14:25.820744 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.820710 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a67b1b89-dfe3-464e-a994-4c9c99cfb610-bound-sa-token\") pod \"cert-manager-55b4d954d5-nmbwk\" (UID: \"a67b1b89-dfe3-464e-a994-4c9c99cfb610\") " pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:25.820957 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.820790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9fd\" (UniqueName: \"kubernetes.io/projected/a67b1b89-dfe3-464e-a994-4c9c99cfb610-kube-api-access-2t9fd\") pod \"cert-manager-55b4d954d5-nmbwk\" (UID: \"a67b1b89-dfe3-464e-a994-4c9c99cfb610\") " pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:25.921929 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.921876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a67b1b89-dfe3-464e-a994-4c9c99cfb610-bound-sa-token\") pod \"cert-manager-55b4d954d5-nmbwk\" (UID: \"a67b1b89-dfe3-464e-a994-4c9c99cfb610\") " pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:25.922123 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.921946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9fd\" (UniqueName: \"kubernetes.io/projected/a67b1b89-dfe3-464e-a994-4c9c99cfb610-kube-api-access-2t9fd\") pod \"cert-manager-55b4d954d5-nmbwk\" (UID: \"a67b1b89-dfe3-464e-a994-4c9c99cfb610\") " pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:25.930392 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.930333 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a67b1b89-dfe3-464e-a994-4c9c99cfb610-bound-sa-token\") pod \"cert-manager-55b4d954d5-nmbwk\" (UID: \"a67b1b89-dfe3-464e-a994-4c9c99cfb610\") " pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:25.930716 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:25.930692 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9fd\" (UniqueName: \"kubernetes.io/projected/a67b1b89-dfe3-464e-a994-4c9c99cfb610-kube-api-access-2t9fd\") pod \"cert-manager-55b4d954d5-nmbwk\" (UID: \"a67b1b89-dfe3-464e-a994-4c9c99cfb610\") " pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:26.106420 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:26.106287 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nmbwk" Jul 23 18:14:26.242311 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:26.242182 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nmbwk"] Jul 23 18:14:26.245015 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:14:26.244980 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda67b1b89_dfe3_464e_a994_4c9c99cfb610.slice/crio-a5c34890f8e046e7960d428822b64930bc07c699bc5afdf9bdd55b41bd49652a WatchSource:0}: Error finding container a5c34890f8e046e7960d428822b64930bc07c699bc5afdf9bdd55b41bd49652a: Status 404 returned error can't find the container with id a5c34890f8e046e7960d428822b64930bc07c699bc5afdf9bdd55b41bd49652a Jul 23 18:14:26.256008 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:26.255985 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xnmcc" Jul 23 18:14:26.276239 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:26.276207 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nmbwk" event={"ID":"a67b1b89-dfe3-464e-a994-4c9c99cfb610","Type":"ContainerStarted","Data":"a5c34890f8e046e7960d428822b64930bc07c699bc5afdf9bdd55b41bd49652a"} Jul 23 18:14:27.282196 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:27.282154 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nmbwk" event={"ID":"a67b1b89-dfe3-464e-a994-4c9c99cfb610","Type":"ContainerStarted","Data":"c4a298dfe4c548a4b449a261fa9a3fb1fefd9e0f9983871e646ecce03dd6237a"} Jul 23 18:14:27.299848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:27.299789 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nmbwk" podStartSLOduration=2.299769729 podStartE2EDuration="2.299769729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:14:27.299492357 +0000 UTC m=+479.918382343" watchObservedRunningTime="2026-07-23 18:14:27.299769729 +0000 UTC m=+479.918659716" Jul 23 18:14:28.576709 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.576669 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv"] Jul 23 18:14:28.581200 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.581182 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.583887 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.583864 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 18:14:28.585024 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.585005 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 18:14:28.585114 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.585028 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s5mrk\"" Jul 23 18:14:28.588326 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.588302 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv"] Jul 23 18:14:28.646118 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.646077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.646271 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.646139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.646271 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.646214 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnd9n\" (UniqueName: \"kubernetes.io/projected/cef2b266-7232-45de-b9d9-0c829fa8a1b8-kube-api-access-lnd9n\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.747330 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.747291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnd9n\" (UniqueName: \"kubernetes.io/projected/cef2b266-7232-45de-b9d9-0c829fa8a1b8-kube-api-access-lnd9n\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.747500 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.747392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.747500 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.747432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.747789 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.747764 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.747831 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.747799 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.756319 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.756293 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnd9n\" (UniqueName: \"kubernetes.io/projected/cef2b266-7232-45de-b9d9-0c829fa8a1b8-kube-api-access-lnd9n\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:28.891805 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:28.891714 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:29.026092 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:29.025929 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv"] Jul 23 18:14:29.028938 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:14:29.028907 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef2b266_7232_45de_b9d9_0c829fa8a1b8.slice/crio-fa1bc7ff5a987ed3438da79dd857f70548a2f0021d08bb8f70325df92c566d17 WatchSource:0}: Error finding container fa1bc7ff5a987ed3438da79dd857f70548a2f0021d08bb8f70325df92c566d17: Status 404 returned error can't find the container with id fa1bc7ff5a987ed3438da79dd857f70548a2f0021d08bb8f70325df92c566d17 Jul 23 18:14:29.292472 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:29.292434 2572 generic.go:356] "Generic (PLEG): container finished" podID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerID="d1508e33f952a55e02d7e82c2fed6d560216b4a50ac49c909fe53e9ed3448158" exitCode=0 Jul 23 18:14:29.292642 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:29.292498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" event={"ID":"cef2b266-7232-45de-b9d9-0c829fa8a1b8","Type":"ContainerDied","Data":"d1508e33f952a55e02d7e82c2fed6d560216b4a50ac49c909fe53e9ed3448158"} Jul 23 18:14:29.292642 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:29.292556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" event={"ID":"cef2b266-7232-45de-b9d9-0c829fa8a1b8","Type":"ContainerStarted","Data":"fa1bc7ff5a987ed3438da79dd857f70548a2f0021d08bb8f70325df92c566d17"} Jul 23 18:14:32.308368 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:32.308307 2572 generic.go:356] "Generic (PLEG): container finished" podID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerID="140d0b35bd433bb5fa601f7251324a8c103b5997859f190e00c2c94674959764" exitCode=0 Jul 23 18:14:32.308798 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:32.308372 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" event={"ID":"cef2b266-7232-45de-b9d9-0c829fa8a1b8","Type":"ContainerDied","Data":"140d0b35bd433bb5fa601f7251324a8c103b5997859f190e00c2c94674959764"} Jul 23 18:14:33.314773 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:33.314734 2572 generic.go:356] "Generic (PLEG): container finished" podID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerID="e671bb7274d6b594dc2a60eed28c5f6ce2f05885ab6bc59c2e69a59f46e996b0" exitCode=0 Jul 23 18:14:33.315230 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:33.314818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" event={"ID":"cef2b266-7232-45de-b9d9-0c829fa8a1b8","Type":"ContainerDied","Data":"e671bb7274d6b594dc2a60eed28c5f6ce2f05885ab6bc59c2e69a59f46e996b0"} Jul 23 18:14:34.449751 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.449722 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:34.502487 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.502450 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-bundle\") pod \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " Jul 23 18:14:34.502655 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.502567 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnd9n\" (UniqueName: \"kubernetes.io/projected/cef2b266-7232-45de-b9d9-0c829fa8a1b8-kube-api-access-lnd9n\") pod \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " Jul 23 18:14:34.502655 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.502601 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-util\") pod \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\" (UID: \"cef2b266-7232-45de-b9d9-0c829fa8a1b8\") " Jul 23 18:14:34.502954 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.502929 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-bundle" (OuterVolumeSpecName: "bundle") pod "cef2b266-7232-45de-b9d9-0c829fa8a1b8" (UID: "cef2b266-7232-45de-b9d9-0c829fa8a1b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:14:34.504760 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.504727 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef2b266-7232-45de-b9d9-0c829fa8a1b8-kube-api-access-lnd9n" (OuterVolumeSpecName: "kube-api-access-lnd9n") pod "cef2b266-7232-45de-b9d9-0c829fa8a1b8" (UID: "cef2b266-7232-45de-b9d9-0c829fa8a1b8"). InnerVolumeSpecName "kube-api-access-lnd9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:14:34.507406 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.507383 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-util" (OuterVolumeSpecName: "util") pod "cef2b266-7232-45de-b9d9-0c829fa8a1b8" (UID: "cef2b266-7232-45de-b9d9-0c829fa8a1b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:14:34.603954 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.603865 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnd9n\" (UniqueName: \"kubernetes.io/projected/cef2b266-7232-45de-b9d9-0c829fa8a1b8-kube-api-access-lnd9n\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:14:34.603954 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.603894 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-util\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:14:34.603954 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:34.603903 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cef2b266-7232-45de-b9d9-0c829fa8a1b8-bundle\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:14:35.326067 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:35.326039 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" Jul 23 18:14:35.326232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:35.326038 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ex7spv" event={"ID":"cef2b266-7232-45de-b9d9-0c829fa8a1b8","Type":"ContainerDied","Data":"fa1bc7ff5a987ed3438da79dd857f70548a2f0021d08bb8f70325df92c566d17"} Jul 23 18:14:35.326232 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:35.326158 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa1bc7ff5a987ed3438da79dd857f70548a2f0021d08bb8f70325df92c566d17" Jul 23 18:14:59.213667 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213629 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv"] Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213936 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="extract" Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213945 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="extract" Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213958 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="util" Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213965 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="util" Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213980 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="pull" Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.213985 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="pull" Jul 23 18:14:59.214128 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.214033 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef2b266-7232-45de-b9d9-0c829fa8a1b8" containerName="extract" Jul 23 18:14:59.216667 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.216648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.219385 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.219358 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 23 18:14:59.219500 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.219358 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:14:59.220425 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.220407 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 23 18:14:59.220516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.220432 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 23 18:14:59.220581 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.220539 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-h5nzw\"" Jul 23 18:14:59.220699 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.220684 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 23 18:14:59.226775 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.226749 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv"] Jul 23 18:14:59.407577 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.407541 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6054f2e4-a078-4736-b71f-87edcd66f8e9-cert\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.407577 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.407587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6054f2e4-a078-4736-b71f-87edcd66f8e9-metrics-certs\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.407838 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.407605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6054f2e4-a078-4736-b71f-87edcd66f8e9-manager-config\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.407838 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.407622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgpl8\" (UniqueName: \"kubernetes.io/projected/6054f2e4-a078-4736-b71f-87edcd66f8e9-kube-api-access-tgpl8\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.508521 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.508401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6054f2e4-a078-4736-b71f-87edcd66f8e9-cert\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.508521 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.508462 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6054f2e4-a078-4736-b71f-87edcd66f8e9-metrics-certs\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.508521 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.508489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6054f2e4-a078-4736-b71f-87edcd66f8e9-manager-config\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.508521 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.508517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgpl8\" (UniqueName: \"kubernetes.io/projected/6054f2e4-a078-4736-b71f-87edcd66f8e9-kube-api-access-tgpl8\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.509190 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.509156 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6054f2e4-a078-4736-b71f-87edcd66f8e9-manager-config\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.511124 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.511098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6054f2e4-a078-4736-b71f-87edcd66f8e9-cert\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.511228 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.511123 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6054f2e4-a078-4736-b71f-87edcd66f8e9-metrics-certs\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.516632 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.516609 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgpl8\" (UniqueName: \"kubernetes.io/projected/6054f2e4-a078-4736-b71f-87edcd66f8e9-kube-api-access-tgpl8\") pod \"jobset-controller-manager-5896c5ff67-wh5dv\" (UID: \"6054f2e4-a078-4736-b71f-87edcd66f8e9\") " pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.526657 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.526631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:14:59.661059 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:14:59.661020 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv"] Jul 23 18:14:59.664828 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:14:59.664802 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6054f2e4_a078_4736_b71f_87edcd66f8e9.slice/crio-e9c51b34c815a8fbab0c27f97cfb3993f37f76c32a1d8b5340dac75309aec82d WatchSource:0}: Error finding container e9c51b34c815a8fbab0c27f97cfb3993f37f76c32a1d8b5340dac75309aec82d: Status 404 returned error can't find the container with id e9c51b34c815a8fbab0c27f97cfb3993f37f76c32a1d8b5340dac75309aec82d Jul 23 18:15:00.436166 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:00.436133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" event={"ID":"6054f2e4-a078-4736-b71f-87edcd66f8e9","Type":"ContainerStarted","Data":"e9c51b34c815a8fbab0c27f97cfb3993f37f76c32a1d8b5340dac75309aec82d"} Jul 23 18:15:03.453716 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:03.453674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" event={"ID":"6054f2e4-a078-4736-b71f-87edcd66f8e9","Type":"ContainerStarted","Data":"65ac4a555754519b7e675da2d7fa9cc034d1f3d6b2332ef44013bae4a983cc3f"} Jul 23 18:15:03.454121 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:03.453822 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:15:03.470746 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:03.470691 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" podStartSLOduration=1.754878888 podStartE2EDuration="4.470674769s" totalImagesPullingTime="2.715795881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:15:03.469200913 +0000 UTC m=+516.088090898" watchObservedRunningTime="2026-07-23 18:15:03.470674769 +0000 UTC m=+516.089564753" Jul 23 18:15:14.464202 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:14.464164 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-5896c5ff67-wh5dv" Jul 23 18:15:49.367180 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.367141 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9"] Jul 23 18:15:49.374173 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.374146 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.377508 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.377476 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-dzgkj\"" Jul 23 18:15:49.377508 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.377498 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 23 18:15:49.377508 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.377497 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 23 18:15:49.378209 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.378191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9"] Jul 23 18:15:49.531168 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.531127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eefd742c-c9a8-42d4-9b13-070c25ceef1d-tmp\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.531168 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.531174 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnhzw\" (UniqueName: \"kubernetes.io/projected/eefd742c-c9a8-42d4-9b13-070c25ceef1d-kube-api-access-fnhzw\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.531483 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.531291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/eefd742c-c9a8-42d4-9b13-070c25ceef1d-manifests-work\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.631888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.631786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/eefd742c-c9a8-42d4-9b13-070c25ceef1d-manifests-work\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.631888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.631848 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eefd742c-c9a8-42d4-9b13-070c25ceef1d-tmp\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.631888 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.631873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnhzw\" (UniqueName: \"kubernetes.io/projected/eefd742c-c9a8-42d4-9b13-070c25ceef1d-kube-api-access-fnhzw\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.632215 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.632196 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/eefd742c-c9a8-42d4-9b13-070c25ceef1d-manifests-work\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.632268 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.632230 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eefd742c-c9a8-42d4-9b13-070c25ceef1d-tmp\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.640408 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.640371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnhzw\" (UniqueName: \"kubernetes.io/projected/eefd742c-c9a8-42d4-9b13-070c25ceef1d-kube-api-access-fnhzw\") pod \"trainer-operator-controller-manager-855d5648d8-qqkr9\" (UID: \"eefd742c-c9a8-42d4-9b13-070c25ceef1d\") " pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.687589 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.687546 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:15:49.825170 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:49.825131 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9"] Jul 23 18:15:49.829098 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:15:49.829063 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefd742c_c9a8_42d4_9b13_070c25ceef1d.slice/crio-54f5e0b5c31435808f828866a0a94d84de1b735c1761f6231323e0adfd9bb70c WatchSource:0}: Error finding container 54f5e0b5c31435808f828866a0a94d84de1b735c1761f6231323e0adfd9bb70c: Status 404 returned error can't find the container with id 54f5e0b5c31435808f828866a0a94d84de1b735c1761f6231323e0adfd9bb70c Jul 23 18:15:50.670248 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:50.670206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" event={"ID":"eefd742c-c9a8-42d4-9b13-070c25ceef1d","Type":"ContainerStarted","Data":"54f5e0b5c31435808f828866a0a94d84de1b735c1761f6231323e0adfd9bb70c"} Jul 23 18:15:52.682429 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:52.682384 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" event={"ID":"eefd742c-c9a8-42d4-9b13-070c25ceef1d","Type":"ContainerStarted","Data":"6b28eb53db955923b550d7e2fb1921b9c5d123ff3a4c93b0e5f188539b95df08"} Jul 23 18:15:52.682848 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:15:52.682471 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:16:03.689985 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:03.689951 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" Jul 23 18:16:03.708919 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:03.708856 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-855d5648d8-qqkr9" podStartSLOduration=12.439402757 podStartE2EDuration="14.708833344s" totalImagesPullingTime="2.269430587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:15:52.698551054 +0000 UTC m=+565.317441038" watchObservedRunningTime="2026-07-23 18:16:03.708833344 +0000 UTC m=+576.327723342" Jul 23 18:16:27.726552 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:27.726521 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:16:27.729560 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:27.729535 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:16:40.635842 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.635799 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57779fcc5d-4ptdh"] Jul 23 18:16:40.640420 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.640396 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.650829 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.650795 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57779fcc5d-4ptdh"] Jul 23 18:16:40.774637 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-oauth-serving-cert\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.774637 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-service-ca\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.774855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-config\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.774855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-trusted-ca-bundle\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.774855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774755 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmxq\" (UniqueName: \"kubernetes.io/projected/4dbafb0b-409e-45d6-b17e-2b23a05da80d-kube-api-access-2bmxq\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.774855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-serving-cert\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.774855 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.774816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-oauth-config\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.875893 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.875849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-config\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.875905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-trusted-ca-bundle\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.875934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmxq\" (UniqueName: \"kubernetes.io/projected/4dbafb0b-409e-45d6-b17e-2b23a05da80d-kube-api-access-2bmxq\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.875969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-serving-cert\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.875989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-oauth-config\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.876016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-oauth-serving-cert\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876093 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.876035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-service-ca\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876769 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.876743 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-config\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876870 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.876742 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-oauth-serving-cert\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876870 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.876809 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-service-ca\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.876870 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.876832 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbafb0b-409e-45d6-b17e-2b23a05da80d-trusted-ca-bundle\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.878538 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.878514 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-oauth-config\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.878715 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.878696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dbafb0b-409e-45d6-b17e-2b23a05da80d-console-serving-cert\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.885227 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.885198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmxq\" (UniqueName: \"kubernetes.io/projected/4dbafb0b-409e-45d6-b17e-2b23a05da80d-kube-api-access-2bmxq\") pod \"console-57779fcc5d-4ptdh\" (UID: \"4dbafb0b-409e-45d6-b17e-2b23a05da80d\") " pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:40.951408 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:40.951297 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:41.099862 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:41.099826 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57779fcc5d-4ptdh"] Jul 23 18:16:41.101243 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:16:41.101210 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbafb0b_409e_45d6_b17e_2b23a05da80d.slice/crio-95cbcefd1a5d7b7c15359088a59dd15e79d162d3233c4610e8e967d6673c6401 WatchSource:0}: Error finding container 95cbcefd1a5d7b7c15359088a59dd15e79d162d3233c4610e8e967d6673c6401: Status 404 returned error can't find the container with id 95cbcefd1a5d7b7c15359088a59dd15e79d162d3233c4610e8e967d6673c6401 Jul 23 18:16:41.914906 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:41.914869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57779fcc5d-4ptdh" event={"ID":"4dbafb0b-409e-45d6-b17e-2b23a05da80d","Type":"ContainerStarted","Data":"07c7a8417d9d77a497d840ca5af211d6c51c869e99fd75ecdfe466b6892b5db6"} Jul 23 18:16:41.915423 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:41.914922 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57779fcc5d-4ptdh" event={"ID":"4dbafb0b-409e-45d6-b17e-2b23a05da80d","Type":"ContainerStarted","Data":"95cbcefd1a5d7b7c15359088a59dd15e79d162d3233c4610e8e967d6673c6401"} Jul 23 18:16:41.946681 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:41.946618 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57779fcc5d-4ptdh" podStartSLOduration=1.946597038 podStartE2EDuration="1.946597038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:41.945251544 +0000 UTC m=+614.564141531" watchObservedRunningTime="2026-07-23 18:16:41.946597038 +0000 UTC m=+614.565487023" Jul 23 18:16:50.951980 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:50.951888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:50.952504 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:50.952047 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:50.957792 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:50.957764 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:51.964213 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:51.964131 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57779fcc5d-4ptdh" Jul 23 18:16:52.013907 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:16:52.013861 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8f49b47d-9tpfw"] Jul 23 18:17:17.039581 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.039538 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f8f49b47d-9tpfw" podUID="aedd4077-ff1b-469c-a5eb-645ba01133f6" containerName="console" containerID="cri-o://2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a" gracePeriod=15 Jul 23 18:17:17.298623 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.298548 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:17:17.374077 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374034 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-config\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374276 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374085 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7ms8\" (UniqueName: \"kubernetes.io/projected/aedd4077-ff1b-469c-a5eb-645ba01133f6-kube-api-access-m7ms8\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374276 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374137 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-oauth-serving-cert\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374276 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374167 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-service-ca\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374276 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374196 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-oauth-config\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374276 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374223 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-serving-cert\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374616 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374397 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-trusted-ca-bundle\") pod \"aedd4077-ff1b-469c-a5eb-645ba01133f6\" (UID: \"aedd4077-ff1b-469c-a5eb-645ba01133f6\") " Jul 23 18:17:17.374616 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374524 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-config" (OuterVolumeSpecName: "console-config") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:17:17.374724 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374674 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:17:17.374778 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374711 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:17:17.374778 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374757 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-config\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:17.374870 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374779 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-oauth-serving-cert\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:17.375017 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.374996 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:17:17.376559 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.376538 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aedd4077-ff1b-469c-a5eb-645ba01133f6-kube-api-access-m7ms8" (OuterVolumeSpecName: "kube-api-access-m7ms8") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "kube-api-access-m7ms8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:17:17.376857 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.376841 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:17:17.376920 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.376875 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aedd4077-ff1b-469c-a5eb-645ba01133f6" (UID: "aedd4077-ff1b-469c-a5eb-645ba01133f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:17:17.475538 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.475492 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-service-ca\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:17.475538 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.475529 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-oauth-config\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:17.475538 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.475543 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedd4077-ff1b-469c-a5eb-645ba01133f6-console-serving-cert\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:17.475787 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.475557 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedd4077-ff1b-469c-a5eb-645ba01133f6-trusted-ca-bundle\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:17.475787 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:17.475570 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7ms8\" (UniqueName: \"kubernetes.io/projected/aedd4077-ff1b-469c-a5eb-645ba01133f6-kube-api-access-m7ms8\") on node \"ip-10-0-129-157.ec2.internal\" DevicePath \"\"" Jul 23 18:17:18.078283 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.078246 2572 generic.go:356] "Generic (PLEG): container finished" podID="aedd4077-ff1b-469c-a5eb-645ba01133f6" containerID="2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a" exitCode=0 Jul 23 18:17:18.078751 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.078296 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8f49b47d-9tpfw" Jul 23 18:17:18.078751 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.078329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8f49b47d-9tpfw" event={"ID":"aedd4077-ff1b-469c-a5eb-645ba01133f6","Type":"ContainerDied","Data":"2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a"} Jul 23 18:17:18.078751 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.078396 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8f49b47d-9tpfw" event={"ID":"aedd4077-ff1b-469c-a5eb-645ba01133f6","Type":"ContainerDied","Data":"896cb7ecbcccff7e31c4d1f04992f94606beb0f4a5feda8c2cebe7aa02bf53e4"} Jul 23 18:17:18.078751 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.078416 2572 scope.go:117] "RemoveContainer" containerID="2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a" Jul 23 18:17:18.087290 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.087269 2572 scope.go:117] "RemoveContainer" containerID="2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a" Jul 23 18:17:18.087662 ip-10-0-129-157 kubenswrapper[2572]: E0723 18:17:18.087638 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a\": container with ID starting with 2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a not found: ID does not exist" containerID="2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a" Jul 23 18:17:18.087733 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.087672 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a"} err="failed to get container status \"2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a\": rpc error: code = NotFound desc = could not find container \"2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a\": container with ID starting with 2e5d684dd8d22cd40397961c801224a49b5e636adb8dc6041fa7adb787569c6a not found: ID does not exist" Jul 23 18:17:18.100525 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.100496 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8f49b47d-9tpfw"] Jul 23 18:17:18.104186 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.104157 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f8f49b47d-9tpfw"] Jul 23 18:17:18.518682 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:17:18.518598 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aedd4077-ff1b-469c-a5eb-645ba01133f6" path="/var/lib/kubelet/pods/aedd4077-ff1b-469c-a5eb-645ba01133f6/volumes" Jul 23 18:19:16.379361 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:16.379313 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7d978_1737c532-e69c-4f3c-8cc7-7b8c0b6d1167/global-pull-secret-syncer/0.log" Jul 23 18:19:16.532532 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:16.532504 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h6th7_d6fcb5a0-81a7-4ec9-ba65-b134756ac48e/konnectivity-agent/0.log" Jul 23 18:19:16.591765 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:16.591734 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-157.ec2.internal_f72d47411db597d9e8c9b9703e40acca/haproxy/0.log" Jul 23 18:19:19.955932 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:19.955897 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-vgq5g_5b07263b-a539-4682-9432-1044314bd484/cluster-monitoring-operator/0.log" Jul 23 18:19:20.320560 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.320531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnz9q_8b1787e5-4cb4-45a6-be12-6e2498303cf3/node-exporter/0.log" Jul 23 18:19:20.340218 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.340187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnz9q_8b1787e5-4cb4-45a6-be12-6e2498303cf3/kube-rbac-proxy/0.log" Jul 23 18:19:20.359280 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.359251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnz9q_8b1787e5-4cb4-45a6-be12-6e2498303cf3/init-textfile/0.log" Jul 23 18:19:20.650606 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.650533 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-m5qrj_b73d7e58-14f5-44a3-b3b1-e758eae53cef/prometheus-operator/0.log" Jul 23 18:19:20.667847 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.667826 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-m5qrj_b73d7e58-14f5-44a3-b3b1-e758eae53cef/kube-rbac-proxy/0.log" Jul 23 18:19:20.728516 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.728488 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75c9d44c69-jjd2r_e729b419-f82b-4aff-8fa1-7475e3231b3e/telemeter-client/0.log" Jul 23 18:19:20.750363 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.750310 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75c9d44c69-jjd2r_e729b419-f82b-4aff-8fa1-7475e3231b3e/reload/0.log" Jul 23 18:19:20.769719 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.769690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75c9d44c69-jjd2r_e729b419-f82b-4aff-8fa1-7475e3231b3e/kube-rbac-proxy/0.log" Jul 23 18:19:20.797956 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.797931 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74458f7f68-mhbxf_6c434aa8-dc24-4897-b925-d798fddc8367/thanos-query/0.log" Jul 23 18:19:20.821278 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.821249 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74458f7f68-mhbxf_6c434aa8-dc24-4897-b925-d798fddc8367/kube-rbac-proxy-web/0.log" Jul 23 18:19:20.846235 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.846207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74458f7f68-mhbxf_6c434aa8-dc24-4897-b925-d798fddc8367/kube-rbac-proxy/0.log" Jul 23 18:19:20.865871 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.865843 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74458f7f68-mhbxf_6c434aa8-dc24-4897-b925-d798fddc8367/prom-label-proxy/0.log" Jul 23 18:19:20.891387 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.891326 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74458f7f68-mhbxf_6c434aa8-dc24-4897-b925-d798fddc8367/kube-rbac-proxy-rules/0.log" Jul 23 18:19:20.912971 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:20.912869 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74458f7f68-mhbxf_6c434aa8-dc24-4897-b925-d798fddc8367/kube-rbac-proxy-metrics/0.log" Jul 23 18:19:23.012382 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:23.012325 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57779fcc5d-4ptdh_4dbafb0b-409e-45d6-b17e-2b23a05da80d/console/0.log" Jul 23 18:19:23.503502 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:23.503468 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-zhc8g_11d58b3f-5e2e-4994-9e94-702a656f6b02/volume-data-source-validator/0.log" Jul 23 18:19:24.112875 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.112837 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7"] Jul 23 18:19:24.113263 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.113193 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aedd4077-ff1b-469c-a5eb-645ba01133f6" containerName="console" Jul 23 18:19:24.113263 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.113206 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aedd4077-ff1b-469c-a5eb-645ba01133f6" containerName="console" Jul 23 18:19:24.113332 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.113267 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aedd4077-ff1b-469c-a5eb-645ba01133f6" containerName="console" Jul 23 18:19:24.116309 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.116285 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.120792 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.120767 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2h2z\"/\"kube-root-ca.crt\"" Jul 23 18:19:24.120937 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.120815 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2h2z\"/\"openshift-service-ca.crt\"" Jul 23 18:19:24.122076 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.122041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2h2z\"/\"default-dockercfg-bnlz8\"" Jul 23 18:19:24.127005 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.126982 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7"] Jul 23 18:19:24.251753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.251717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-sys\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.251753 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.251760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbsg\" (UniqueName: \"kubernetes.io/projected/151f0baf-df13-45ec-b0db-4ebbefa86238-kube-api-access-bnbsg\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.251973 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.251785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-podres\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.251973 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.251868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-lib-modules\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.251973 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.251915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-proc\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-lib-modules\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353095 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-proc\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353304 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-sys\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353304 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbsg\" (UniqueName: \"kubernetes.io/projected/151f0baf-df13-45ec-b0db-4ebbefa86238-kube-api-access-bnbsg\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353304 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-podres\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353304 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353247 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-lib-modules\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353304 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-proc\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353304 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353257 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-sys\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.353534 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.353326 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/151f0baf-df13-45ec-b0db-4ebbefa86238-podres\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.362066 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.362035 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbsg\" (UniqueName: \"kubernetes.io/projected/151f0baf-df13-45ec-b0db-4ebbefa86238-kube-api-access-bnbsg\") pod \"perf-node-gather-daemonset-s7lr7\" (UID: \"151f0baf-df13-45ec-b0db-4ebbefa86238\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.402218 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.402113 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j6kj4_932af207-0c99-4fa7-b8ac-106141a1f364/dns/0.log" Jul 23 18:19:24.420862 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.420825 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j6kj4_932af207-0c99-4fa7-b8ac-106141a1f364/kube-rbac-proxy/0.log" Jul 23 18:19:24.426842 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.426816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.483117 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.483086 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vtmfd_05a8347e-f1f4-4635-bb0a-a3898f8ea9d6/dns-node-resolver/0.log" Jul 23 18:19:24.566233 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.566197 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7"] Jul 23 18:19:24.570302 ip-10-0-129-157 kubenswrapper[2572]: W0723 18:19:24.570272 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod151f0baf_df13_45ec_b0db_4ebbefa86238.slice/crio-4fd029a7b94cd237a93895262ff3773af7c3aafe2506a8f731c3c8131ad61612 WatchSource:0}: Error finding container 4fd029a7b94cd237a93895262ff3773af7c3aafe2506a8f731c3c8131ad61612: Status 404 returned error can't find the container with id 4fd029a7b94cd237a93895262ff3773af7c3aafe2506a8f731c3c8131ad61612 Jul 23 18:19:24.646875 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.646840 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" event={"ID":"151f0baf-df13-45ec-b0db-4ebbefa86238","Type":"ContainerStarted","Data":"12754d962993489ca5b9894799e25934a637e166722851b4dab99c3a3841c8ef"} Jul 23 18:19:24.647042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.646892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" event={"ID":"151f0baf-df13-45ec-b0db-4ebbefa86238","Type":"ContainerStarted","Data":"4fd029a7b94cd237a93895262ff3773af7c3aafe2506a8f731c3c8131ad61612"} Jul 23 18:19:24.647042 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.646921 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:24.664123 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.664027 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" podStartSLOduration=0.664010921 podStartE2EDuration="664.010921ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:19:24.662957808 +0000 UTC m=+777.281847806" watchObservedRunningTime="2026-07-23 18:19:24.664010921 +0000 UTC m=+777.282900905" Jul 23 18:19:24.894061 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:24.894036 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mw6z5_8a0e9307-d975-447c-9196-9f5b2e3131ac/node-ca/0.log" Jul 23 18:19:25.822984 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:25.822954 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vmgn_d32bf6fa-e4a0-480a-803d-c2da79c18e17/serve-healthcheck-canary/0.log" Jul 23 18:19:26.287900 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:26.287872 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xd9x5_cf03283f-e83e-4b49-b8f6-715edf72281b/kube-rbac-proxy/0.log" Jul 23 18:19:26.304178 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:26.304150 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xd9x5_cf03283f-e83e-4b49-b8f6-715edf72281b/exporter/0.log" Jul 23 18:19:26.322024 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:26.321997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xd9x5_cf03283f-e83e-4b49-b8f6-715edf72281b/extractor/0.log" Jul 23 18:19:27.877032 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:27.876999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-5896c5ff67-wh5dv_6054f2e4-a078-4736-b71f-87edcd66f8e9/manager/0.log" Jul 23 18:19:30.661502 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:30.661477 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-s7lr7" Jul 23 18:19:30.971321 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:30.971244 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tp2r4_33d5cb9a-1941-4860-89e0-3bc19b7d56a7/kube-storage-version-migrator-operator/1.log" Jul 23 18:19:30.972267 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:30.972248 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tp2r4_33d5cb9a-1941-4860-89e0-3bc19b7d56a7/kube-storage-version-migrator-operator/0.log" Jul 23 18:19:32.072331 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.072304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/kube-multus-additional-cni-plugins/0.log" Jul 23 18:19:32.090229 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.090200 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/egress-router-binary-copy/0.log" Jul 23 18:19:32.110050 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.110018 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/cni-plugins/0.log" Jul 23 18:19:32.128300 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.128274 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/bond-cni-plugin/0.log" Jul 23 18:19:32.146184 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.146158 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/routeoverride-cni/0.log" Jul 23 18:19:32.166321 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.166294 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/whereabouts-cni-bincopy/0.log" Jul 23 18:19:32.184084 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.184057 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwzxp_96009908-abbc-435e-b0f7-6171e463b280/whereabouts-cni/0.log" Jul 23 18:19:32.263169 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.263139 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vgml4_852c854e-8538-4df8-b9cc-1d7b0b1ef8ac/kube-multus/0.log" Jul 23 18:19:32.368969 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.368937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z8dkb_c52668d7-cb37-4865-886e-de9262b6f8f0/network-metrics-daemon/0.log" Jul 23 18:19:32.385857 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:32.385833 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z8dkb_c52668d7-cb37-4865-886e-de9262b6f8f0/kube-rbac-proxy/0.log" Jul 23 18:19:33.379574 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.379546 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-controller/0.log" Jul 23 18:19:33.400843 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.400793 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/1.log" Jul 23 18:19:33.400992 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.400883 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovn-acl-logging/0.log" Jul 23 18:19:33.424318 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.424288 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/kube-rbac-proxy-node/0.log" Jul 23 18:19:33.442764 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.442732 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 18:19:33.459772 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.459699 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/northd/0.log" Jul 23 18:19:33.481031 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.481006 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/nbdb/0.log" Jul 23 18:19:33.498720 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.498693 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/sbdb/0.log" Jul 23 18:19:33.532262 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:33.532231 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxrwf_9a073930-43c6-4ba1-8db2-557caa9e7641/ovnkube-controller/0.log" Jul 23 18:19:34.631906 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:34.631827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hzpn6_56d1d355-b521-42c8-a6d2-413d5b212dbd/network-check-target-container/0.log" Jul 23 18:19:35.501717 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:35.501680 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vqlbx_50715535-157b-4b6e-83e9-2d80f722caec/iptables-alerter/0.log" Jul 23 18:19:36.064502 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:36.064467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-psb7m_a110fc2c-16b6-4df0-b273-3b83bbfa68e8/tuned/0.log" Jul 23 18:19:37.544403 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:37.544358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-zg2gh_0ba9adf5-5f41-42da-9d57-aca3eb33ca64/cluster-samples-operator/0.log" Jul 23 18:19:37.557834 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:37.557810 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-zg2gh_0ba9adf5-5f41-42da-9d57-aca3eb33ca64/cluster-samples-operator-watch/0.log" Jul 23 18:19:38.412256 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:38.412209 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-lv7wp_e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec/service-ca-operator/1.log" Jul 23 18:19:38.412956 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:38.412940 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-lv7wp_e0b0f1ea-1b4d-48ae-8a65-46d9cdb3bfec/service-ca-operator/0.log" Jul 23 18:19:38.691638 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:38.691557 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-58598695f7-gdhks_b6ef5623-5591-4531-8214-6204e33a8c84/service-ca-controller/0.log" Jul 23 18:19:39.067951 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:39.067911 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ntrk7_ff7c18a2-218e-40dc-aec3-b0f3bf5ae433/csi-driver/0.log" Jul 23 18:19:39.088612 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:39.088554 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ntrk7_ff7c18a2-218e-40dc-aec3-b0f3bf5ae433/csi-node-driver-registrar/0.log" Jul 23 18:19:39.111666 ip-10-0-129-157 kubenswrapper[2572]: I0723 18:19:39.111633 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ntrk7_ff7c18a2-218e-40dc-aec3-b0f3bf5ae433/csi-liveness-probe/0.log"