Jul 21 07:49:32.044064 ip-10-0-131-166 systemd[1]: Starting Kubernetes Kubelet... Jul 21 07:49:32.432703 ip-10-0-131-166 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 07:49:32.432703 ip-10-0-131-166 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 07:49:32.432703 ip-10-0-131-166 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 07:49:32.432703 ip-10-0-131-166 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 07:49:32.432703 ip-10-0-131-166 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 07:49:32.433540 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.433480 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 07:49:32.438710 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438696 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 07:49:32.438710 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438709 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 07:49:32.438710 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438713 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438716 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438719 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438722 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438737 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438740 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438743 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438745 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438748 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438750 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438753 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438755 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438758 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438760 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438765 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438768 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438771 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438773 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438781 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 07:49:32.438808 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438784 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438787 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438789 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438791 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438795 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438799 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438802 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438805 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438808 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438810 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438813 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438816 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438818 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438822 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438824 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438827 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438829 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438832 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438834 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 07:49:32.439236 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438837 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438839 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438841 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438844 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438846 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438849 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438851 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438853 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438856 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438859 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438861 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438864 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438866 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438869 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438872 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438875 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438878 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438880 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438882 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438885 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 07:49:32.439676 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438887 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438890 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438892 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438895 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438897 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438900 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438902 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438905 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438907 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438909 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438912 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438915 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438918 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438920 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438923 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438925 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438928 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438930 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438932 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438936 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 07:49:32.440152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438938 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438941 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438944 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438948 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438951 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438954 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438956 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438959 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438962 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438964 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438967 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438970 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438972 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438975 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438977 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438980 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438982 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438984 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.438987 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 07:49:32.440605 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439637 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439645 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439649 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439652 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439666 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439671 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439674 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439677 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439680 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439682 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439685 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439688 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439690 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439693 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439695 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439698 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439701 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439703 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439706 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439709 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 07:49:32.441061 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439711 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439714 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439716 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439719 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439722 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439739 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439742 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439745 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439747 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439750 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439753 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439755 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439758 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439760 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439763 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439765 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439768 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439770 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439774 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439776 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 07:49:32.441540 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439779 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439781 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439785 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439789 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439791 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439795 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439799 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439802 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439805 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439807 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439811 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439814 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439816 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439819 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439822 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439825 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439828 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439830 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439833 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 07:49:32.442024 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439836 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439839 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439841 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439844 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439846 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439849 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439852 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439854 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439857 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439859 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439862 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439866 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439870 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439873 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439875 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439878 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439880 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439883 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439885 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 07:49:32.442462 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439888 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439890 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439893 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439895 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439897 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439900 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439902 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439905 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439907 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439910 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439913 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439916 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439918 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439920 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439923 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439926 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439928 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439931 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439933 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439935 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 07:49:32.442947 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.439938 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440261 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440264 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440268 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440271 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440274 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440276 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440279 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440281 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440284 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440286 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440289 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440292 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440295 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440297 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440300 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440302 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440305 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440307 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 07:49:32.443399 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440310 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440312 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440314 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440317 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440319 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440322 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440324 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440327 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440329 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440331 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440334 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440336 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440338 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440341 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440343 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440346 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440350 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440353 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440356 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440359 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 07:49:32.443895 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440361 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440364 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440366 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440368 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440371 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440373 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440376 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440378 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440380 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440383 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440385 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440388 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440390 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440392 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440395 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440397 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440399 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440402 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440404 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440406 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 07:49:32.444387 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440409 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440412 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440414 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440416 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440418 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440421 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440424 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440426 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440431 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440434 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440437 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440441 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440443 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440446 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440449 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440471 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440476 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440479 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440482 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440484 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 07:49:32.444868 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440487 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440491 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440495 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440498 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440501 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440504 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440506 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440509 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440512 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440514 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440517 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440519 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440522 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440524 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440526 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440529 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440531 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440534 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440536 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 07:49:32.445316 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.440539 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440604 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440615 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440621 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440625 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440631 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440635 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440641 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440646 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440651 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440655 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440659 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440663 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440666 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440669 2578 flags.go:64] FLAG: --cgroup-root="" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440672 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440675 2578 flags.go:64] FLAG: --client-ca-file="" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440677 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440680 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440684 2578 flags.go:64] FLAG: --cluster-domain="" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440686 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440689 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440692 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440696 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 07:49:32.445810 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440699 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440702 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440705 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440708 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440710 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440713 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440716 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440719 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440722 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440740 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440743 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440746 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440748 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440751 2578 flags.go:64] FLAG: --enable-server="true" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440755 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440759 2578 flags.go:64] FLAG: --event-burst="100" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440762 2578 flags.go:64] FLAG: --event-qps="50" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440764 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440767 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440770 2578 flags.go:64] FLAG: --eviction-hard="" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440776 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440779 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440781 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440784 2578 flags.go:64] FLAG: --eviction-soft="" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440787 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 07:49:32.446378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440790 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440793 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440796 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440798 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440801 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440804 2578 flags.go:64] FLAG: --feature-gates="" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440807 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440811 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440814 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440817 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440820 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440823 2578 flags.go:64] FLAG: --help="false" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440826 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440829 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440832 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440835 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440839 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440842 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440845 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440848 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440850 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440853 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440856 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440859 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 07:49:32.447008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440862 2578 flags.go:64] FLAG: --kube-reserved="" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440865 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440867 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440870 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440873 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440875 2578 flags.go:64] FLAG: --lock-file="" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440878 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440881 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440884 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440888 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440891 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440894 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440896 2578 flags.go:64] FLAG: --logging-format="text" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440899 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440902 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440906 2578 flags.go:64] FLAG: --manifest-url="" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440909 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440912 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440915 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440919 2578 flags.go:64] FLAG: --max-pods="110" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440922 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440924 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440927 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440930 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440934 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 07:49:32.447580 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440936 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440939 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440946 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440948 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440951 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440954 2578 flags.go:64] FLAG: --pod-cidr="" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440957 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440962 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440965 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440968 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440971 2578 flags.go:64] FLAG: --port="10250" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440973 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440976 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f8e79d61c4ae63d" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440979 2578 flags.go:64] FLAG: --qos-reserved="" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440982 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440986 2578 flags.go:64] FLAG: --register-node="true" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440988 2578 flags.go:64] FLAG: --register-with-taints="" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440992 2578 flags.go:64] FLAG: --registry-burst="10" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440995 2578 flags.go:64] FLAG: --registry-qps="5" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.440997 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441000 2578 flags.go:64] FLAG: --reserved-memory="" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441003 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441007 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441010 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441013 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 07:49:32.448190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441016 2578 flags.go:64] FLAG: --runonce="false" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441018 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441021 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441024 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441027 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441030 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441032 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441036 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441039 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441042 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441045 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441048 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441050 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441053 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441056 2578 flags.go:64] FLAG: --system-cgroups="" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441059 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441064 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441067 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441070 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441074 2578 flags.go:64] FLAG: --tls-min-version="" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441077 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441079 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441082 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441084 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441087 2578 flags.go:64] FLAG: --v="2" Jul 21 07:49:32.448796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441091 2578 flags.go:64] FLAG: --version="false" Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441095 2578 flags.go:64] FLAG: --vmodule="" Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441098 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441101 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441209 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441212 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441217 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441220 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441223 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441226 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441229 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441231 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441233 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441236 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441239 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441241 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441244 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441246 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441249 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441251 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 07:49:32.449415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441254 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441256 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441259 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441262 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441264 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441266 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441269 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441271 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441274 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441276 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441279 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441281 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441284 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441286 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441289 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441291 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441295 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441297 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441300 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441302 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 07:49:32.449916 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441305 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441307 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441310 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441312 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441315 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441317 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441320 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441322 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441325 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441327 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441330 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441332 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441334 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441337 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441339 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441342 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441344 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441347 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441349 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 07:49:32.450385 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441352 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441354 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441356 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441359 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441361 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441364 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441366 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441369 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441373 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441377 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441380 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441383 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441386 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441389 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441392 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441395 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441397 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441400 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441402 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 07:49:32.450914 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441405 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441407 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441409 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441412 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441414 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441416 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441419 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441421 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441424 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441428 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441431 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441434 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441436 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441438 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441441 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441443 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441446 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441448 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441450 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441452 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 07:49:32.451357 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441455 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441457 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441461 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441463 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.441466 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.441999 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.447938 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.447954 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.447972 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.447981 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448042 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448046 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448050 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448052 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 07:49:32.451846 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448054 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448057 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448059 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448062 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448064 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448067 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448069 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448071 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448074 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448076 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448079 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448081 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448084 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448086 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448089 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448093 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448096 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448099 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448103 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 07:49:32.452172 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448106 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448109 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448112 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448115 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448117 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448120 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448128 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448132 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448134 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448137 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448139 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448142 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448145 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448147 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448150 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448152 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448155 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448157 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448160 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448162 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 07:49:32.452615 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448165 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448168 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448170 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448173 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448176 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448178 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448180 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448183 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448186 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448188 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448191 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448193 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448196 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448198 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448201 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448204 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448207 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448211 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448214 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 07:49:32.453092 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448223 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448226 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448228 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448231 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448233 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448236 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448238 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448241 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448243 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448246 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448248 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448251 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448253 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448255 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448258 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448260 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448263 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448265 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448267 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448270 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 21 07:49:32.453572 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448272 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448275 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448277 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448280 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448282 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448285 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448287 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448290 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448292 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448295 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448297 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448300 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448303 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448311 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448314 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448316 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 07:49:32.454064 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448319 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.448323 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448460 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448464 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448467 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448469 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448472 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448474 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448477 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448479 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448482 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448485 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448487 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448490 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448492 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 07:49:32.454459 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448495 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448497 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448499 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448502 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448504 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448507 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448509 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448512 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448514 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448516 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448519 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448521 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448524 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448527 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448529 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448538 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448542 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448544 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448547 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 07:49:32.454826 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448550 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448552 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448556 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448559 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448562 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448564 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448567 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448570 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448572 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448575 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448577 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448579 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448582 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448584 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448586 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448589 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448591 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448593 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448596 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 07:49:32.455267 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448598 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448600 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448603 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448605 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448608 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448610 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448613 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448615 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448617 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448620 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448628 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448630 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448633 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448635 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448637 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448640 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448642 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448644 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448647 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448649 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 07:49:32.455806 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448651 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448654 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448656 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448658 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448661 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448663 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448666 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448668 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448671 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448674 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448677 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448680 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448683 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448686 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448688 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448690 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448693 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448695 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448698 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448700 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 07:49:32.456263 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448702 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448705 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448707 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448716 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448719 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448721 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448737 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:32.448741 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.448746 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.448864 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.451541 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.452929 2578 server.go:1019] "Starting client certificate rotation" Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.453021 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 07:49:32.457050 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.453885 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 07:49:32.457545 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.455276 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 07:49:32.460631 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.460610 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 07:49:32.471713 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.471696 2578 log.go:25] "Validated CRI v1 runtime API" Jul 21 07:49:32.473533 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.473520 2578 log.go:25] "Validated CRI v1 image API" Jul 21 07:49:32.475794 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.475778 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 07:49:32.478038 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.478017 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 be85580c-974a-4353-827c-86d3b3c96a83:/dev/nvme0n1p4 cab1b0a9-3d21-4034-91ec-96e045053210:/dev/nvme0n1p3] Jul 21 07:49:32.478108 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.478037 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 07:49:32.482119 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.482010 2578 manager.go:216] Machine: {Timestamp:2026-07-21 07:49:32.481552155 +0000 UTC m=+0.321871861 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204278 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2aff4a253aa88d1fcfc91d12900e SystemUUID:ec2d2aff-4a25-3aa8-8d1f-cfc91d12900e BootID:7f9eb890-65ed-4190-9891-8e10aa078325 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:00:39:66:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:00:39:66:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:04:42:82:29:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 07:49:32.482119 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.482109 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 07:49:32.482261 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.482191 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 07:49:32.482668 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.482653 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 07:49:32.485661 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.485636 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 07:49:32.485789 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.485664 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 07:49:32.486589 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.486579 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 07:49:32.486622 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.486591 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 07:49:32.486622 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.486598 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 07:49:32.487347 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.487337 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 07:49:32.488683 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.488674 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 07:49:32.491126 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491115 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 21 07:49:32.491223 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491214 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 07:49:32.491257 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491241 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 21 07:49:32.491283 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491256 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 07:49:32.491283 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491269 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 07:49:32.491283 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491277 2578 kubelet.go:398] "Adding apiserver pod source" Jul 21 07:49:32.491385 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491289 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 07:49:32.491595 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491585 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 07:49:32.491643 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.491604 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 07:49:32.493590 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.493575 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 07:49:32.495653 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.495637 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 07:49:32.495750 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.495681 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 07:49:32.496885 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496872 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496891 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496899 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496907 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496919 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496927 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496951 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 07:49:32.496963 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496959 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 07:49:32.497162 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496967 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 07:49:32.497162 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496975 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 07:49:32.497162 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.496992 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 07:49:32.497162 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.497001 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 07:49:32.498296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.498285 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 07:49:32.498348 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.498298 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 07:49:32.501299 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.501267 2578 server.go:1268] "Started kubelet" Jul 21 07:49:32.503836 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.501456 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 07:49:32.503925 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.501427 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 07:49:32.503925 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.503862 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 07:49:32.504288 ip-10-0-131-166 systemd[1]: Started Kubernetes Kubelet. Jul 21 07:49:32.505015 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.504940 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sp9fz" Jul 21 07:49:32.505494 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.505467 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 07:49:32.505951 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.505902 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 07:49:32.506039 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.506010 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 07:49:32.506177 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.506152 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 07:49:32.507651 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.507638 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 21 07:49:32.509631 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.509602 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sp9fz" Jul 21 07:49:32.509718 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.509701 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 07:49:32.510676 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.509855 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-166.ec2.internal.18c43e9770ecd5a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-166.ec2.internal,UID:ip-10-0-131-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-166.ec2.internal,},FirstTimestamp:2026-07-21 07:49:32.501112225 +0000 UTC m=+0.341431931,LastTimestamp:2026-07-21 07:49:32.501112225 +0000 UTC m=+0.341431931,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-166.ec2.internal,}" Jul 21 07:49:32.514650 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.514634 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 07:49:32.514760 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.514721 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:32.514816 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.514638 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 07:49:32.515160 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515132 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 07:49:32.515160 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515131 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 07:49:32.515160 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515171 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 07:49:32.515337 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515256 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 21 07:49:32.515337 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515265 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 21 07:49:32.515492 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515479 2578 factory.go:55] Registering systemd factory Jul 21 07:49:32.515535 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515494 2578 factory.go:223] Registration of the systemd container factory successfully Jul 21 07:49:32.515695 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515678 2578 factory.go:153] Registering CRI-O factory Jul 21 07:49:32.515695 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515695 2578 factory.go:223] Registration of the crio container factory successfully Jul 21 07:49:32.515815 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515772 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 07:49:32.515815 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515793 2578 factory.go:103] Registering Raw factory Jul 21 07:49:32.515815 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.515813 2578 manager.go:1196] Started watching for new ooms in manager Jul 21 07:49:32.516469 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.516442 2578 manager.go:349] Starting recovery of all containers Jul 21 07:49:32.521815 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.521794 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 07:49:32.524474 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.524456 2578 manager.go:354] Recovery completed Jul 21 07:49:32.526152 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.526131 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-166.ec2.internal\" not found" node="ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.529329 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.529318 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.531021 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531004 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.531087 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531036 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.531087 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531052 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.531511 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531499 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 07:49:32.531579 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531512 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.531579 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531508 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 07:49:32.531579 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.531550 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 21 07:49:32.532206 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.532190 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.532284 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.532216 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.532284 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.532227 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.533154 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.533142 2578 policy_none.go:49] "None policy: Start" Jul 21 07:49:32.533195 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.533158 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 07:49:32.533195 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.533168 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 07:49:32.534044 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.534033 2578 policy_none.go:47] "Start" Jul 21 07:49:32.571789 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.571776 2578 manager.go:337] "Starting Device Plugin manager" Jul 21 07:49:32.571852 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.571801 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 07:49:32.571852 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.571810 2578 server.go:87] "Starting device plugin registration server" Jul 21 07:49:32.572007 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.571997 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 07:49:32.572045 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.572008 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 07:49:32.572188 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.572170 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 07:49:32.572284 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.572242 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 07:49:32.572284 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.572251 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 07:49:32.572560 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.572542 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 07:49:32.572607 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.572593 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:32.645055 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.645034 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 07:49:32.646095 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.646079 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 07:49:32.646172 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.646112 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 07:49:32.646172 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.646131 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 07:49:32.646172 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.646160 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 07:49:32.648571 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.648556 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 07:49:32.672516 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.672503 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.673374 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.673358 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.673451 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.673384 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.673451 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.673396 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.673451 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.673420 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.681610 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.681596 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.681673 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.681619 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-166.ec2.internal\": node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:32.696415 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.696395 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:32.746829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.746794 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"] Jul 21 07:49:32.746917 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.746863 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.747689 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.747674 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.747755 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.747706 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.747755 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.747720 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.749032 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749020 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.749159 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.749200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749191 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.749698 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749680 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.749698 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749689 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.749843 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749704 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.749843 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749715 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.749843 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749705 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.749843 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.749752 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.750901 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.750885 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.750942 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.750918 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 07:49:32.751549 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.751534 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory" Jul 21 07:49:32.751611 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.751564 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 07:49:32.751611 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.751577 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID" Jul 21 07:49:32.782226 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.782208 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-166.ec2.internal\" not found" node="ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.786560 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.786545 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-166.ec2.internal\" not found" node="ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.796836 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.796822 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:32.817232 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.817213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f13e66237d3916f0afcf9e2c5198acae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"f13e66237d3916f0afcf9e2c5198acae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.817311 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.817235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f13e66237d3916f0afcf9e2c5198acae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"f13e66237d3916f0afcf9e2c5198acae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.817311 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.817256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e5bd059099eaa7be4523cc656d99f14-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.ec2.internal\" (UID: \"9e5bd059099eaa7be4523cc656d99f14\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.898785 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.898761 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:32.918104 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.918087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f13e66237d3916f0afcf9e2c5198acae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"f13e66237d3916f0afcf9e2c5198acae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.918198 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.918120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e5bd059099eaa7be4523cc656d99f14-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.ec2.internal\" (UID: \"9e5bd059099eaa7be4523cc656d99f14\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.918198 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.918144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f13e66237d3916f0afcf9e2c5198acae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"f13e66237d3916f0afcf9e2c5198acae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.918198 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.918146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f13e66237d3916f0afcf9e2c5198acae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"f13e66237d3916f0afcf9e2c5198acae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.918198 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.918182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e5bd059099eaa7be4523cc656d99f14-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.ec2.internal\" (UID: \"9e5bd059099eaa7be4523cc656d99f14\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.918198 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:32.918187 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f13e66237d3916f0afcf9e2c5198acae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"f13e66237d3916f0afcf9e2c5198acae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:32.999058 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:32.999019 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.090420 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.090382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:33.090520 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.090397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" Jul 21 07:49:33.100214 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.100073 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.201619 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.201559 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.302554 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.302531 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.405972 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.405950 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.452790 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.452723 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 07:49:33.453171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.452905 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 07:49:33.453171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.452899 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 07:49:33.506876 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.506854 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.513558 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.513519 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 07:44:32 +0000 UTC" deadline="2028-02-04 08:43:12.811404792 +0000 UTC" Jul 21 07:49:33.513558 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.513552 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13512h53m39.297855993s" Jul 21 07:49:33.596202 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:33.596177 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13e66237d3916f0afcf9e2c5198acae.slice/crio-2af4cbefed4878faccaa62d9a9639a720aa5ad2cdcbaba1e74ffd5c5525b2774 WatchSource:0}: Error finding container 2af4cbefed4878faccaa62d9a9639a720aa5ad2cdcbaba1e74ffd5c5525b2774: Status 404 returned error can't find the container with id 2af4cbefed4878faccaa62d9a9639a720aa5ad2cdcbaba1e74ffd5c5525b2774 Jul 21 07:49:33.596415 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:33.596390 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5bd059099eaa7be4523cc656d99f14.slice/crio-f350f9326fd47a6306fef549e6e0eeab666fa03b8ae64f9f9d2b94db2cac7dc5 WatchSource:0}: Error finding container f350f9326fd47a6306fef549e6e0eeab666fa03b8ae64f9f9d2b94db2cac7dc5: Status 404 returned error can't find the container with id f350f9326fd47a6306fef549e6e0eeab666fa03b8ae64f9f9d2b94db2cac7dc5 Jul 21 07:49:33.600134 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.600118 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 07:49:33.607860 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.607843 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.649149 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.649103 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" event={"ID":"9e5bd059099eaa7be4523cc656d99f14","Type":"ContainerStarted","Data":"f350f9326fd47a6306fef549e6e0eeab666fa03b8ae64f9f9d2b94db2cac7dc5"} Jul 21 07:49:33.650053 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.650034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" event={"ID":"f13e66237d3916f0afcf9e2c5198acae","Type":"ContainerStarted","Data":"2af4cbefed4878faccaa62d9a9639a720aa5ad2cdcbaba1e74ffd5c5525b2774"} Jul 21 07:49:33.712059 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.712010 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.756869 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:33.756852 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 07:49:33.816222 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.816203 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:33.916336 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:33.916315 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found" Jul 21 07:49:34.015661 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.015593 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 07:49:34.114890 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.114859 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" Jul 21 07:49:34.127338 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.127317 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 07:49:34.128419 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.128391 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" Jul 21 07:49:34.137170 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.137143 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 07:49:34.492418 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.492355 2578 apiserver.go:52] "Watching apiserver" Jul 21 07:49:34.503195 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.503096 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 07:49:34.503579 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.503546 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-k4p79","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal","openshift-multus/network-metrics-daemon-g8w8j","openshift-network-diagnostics/network-check-target-qgxlv","kube-system/global-pull-secret-syncer-tc2b5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74","openshift-cluster-node-tuning-operator/tuned-k2x4c","openshift-multus/multus-additional-cni-plugins-xd69x","openshift-multus/multus-n6tkl","openshift-network-operator/iptables-alerter-6xmz6","openshift-ovn-kubernetes/ovnkube-node-cxknp","kube-system/konnectivity-agent-7rlw2","kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal","openshift-dns/node-resolver-kth4k"] Jul 21 07:49:34.505471 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.505446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.507202 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.507171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.508153 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.508107 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.508265 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.508242 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.508571 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.508377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t7q5t\"" Jul 21 07:49:34.508698 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.508613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:34.508809 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.508693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:34.509964 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.509770 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 07:49:34.509964 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.509875 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 07:49:34.509964 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.509875 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.510255 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.510239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:34.510319 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.510298 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:34.510796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.510707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 07:49:34.510796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.510716 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.510796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.510764 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 07:49:34.511028 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.511008 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6vfpb\"" Jul 21 07:49:34.511600 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.511542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.511685 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.511599 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:34.513384 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.513366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.515061 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.515038 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 07:49:34.515061 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.515054 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.515690 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.515669 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nh2q7\"" Jul 21 07:49:34.516063 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.516043 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.516153 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.516135 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.516219 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.516140 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 07:49:34.516562 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.516483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.517176 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.517158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 07:49:34.518079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.517921 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.518079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.517935 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.518079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.517953 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wvpbb\"" Jul 21 07:49:34.518079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.518014 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 07:49:34.518344 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.518316 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.519035 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.518967 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.519233 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.519213 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.519233 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.519231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c588v\"" Jul 21 07:49:34.519727 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.519709 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.520461 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.520446 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 07:49:34.521321 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.521266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.521727 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.521660 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 07:49:34.521854 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.521749 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5kxmd\"" Jul 21 07:49:34.522395 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.522226 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.522530 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.522467 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.522738 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.522720 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 07:49:34.523822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.523142 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r8f8g\"" Jul 21 07:49:34.523822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.523324 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.526840 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.524572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 07:49:34.526840 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.524640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 07:49:34.526840 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.524709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-srw6c\"" Jul 21 07:49:34.526840 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.526031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 07:49:34.526840 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.526370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 07:49:34.527203 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.527177 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btnbx\"" Jul 21 07:49:34.527203 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.527195 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 07:49:34.528142 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-cnibin\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.528234 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-modprobe-d\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.528234 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.528234 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-system-cni-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.528234 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-cni-bin\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.528447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-kubelet\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.528447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-run-netns\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.528447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2f54\" (UniqueName: \"kubernetes.io/projected/5a8d7bab-db41-40db-ba10-1d4faafff654-kube-api-access-j2f54\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.528447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-tmp-dir\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.528447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-tuned\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-dbus\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-os-release\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lccb\" (UniqueName: \"kubernetes.io/projected/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-kube-api-access-2lccb\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-etc-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-kubernetes\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysctl-conf\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-netns\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqcgd\" (UniqueName: \"kubernetes.io/projected/c2c025f9-945a-43b0-904d-f7e6d763c836-kube-api-access-dqcgd\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:34.528692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-daemon-config\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-cni-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-hostroot\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-systemd-units\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4x9\" (UniqueName: \"kubernetes.io/projected/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-kube-api-access-zv4x9\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-sys\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-lib-modules\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-ovn\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-env-overrides\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.528978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8d7bab-db41-40db-ba10-1d4faafff654-ovn-node-metrics-cert\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysconfig\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysctl-d\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bab8d59a-b79e-4a46-a366-2a033873dbd6-cni-binary-copy\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-socket-dir-parent\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-cni-multus\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-systemd\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.529279 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-var-lib-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-log-socket\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-kubelet\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-kubelet-config\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-hosts-file\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-cni-bin\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-cni-netd\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-ovnkube-config\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ggp\" (UniqueName: \"kubernetes.io/projected/19d829fa-efbb-4416-b352-1d9fc1a415a5-kube-api-access-n5ggp\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19d829fa-efbb-4416-b352-1d9fc1a415a5-tmp\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-registration-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-etc-kubernetes\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-k8s-cni-cncf-io\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.530093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-var-lib-kubelet\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-socket-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-conf-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-multus-certs\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbd9p\" (UniqueName: \"kubernetes.io/projected/bab8d59a-b79e-4a46-a366-2a033873dbd6-kube-api-access-lbd9p\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-slash\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-node-log\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-ovnkube-script-lib\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-systemd\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-run\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-host\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-device-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.530928 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.529831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-sys-fs\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.532894 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.532870 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 07:49:34.548697 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.548676 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mrhnv" Jul 21 07:49:34.557106 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.557089 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mrhnv" Jul 21 07:49:34.616499 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.616432 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 07:49:34.630497 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-kubelet-config\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.630606 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-hosts-file\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.630606 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-cni-bin\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630606 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-cni-netd\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630606 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-cni-netd\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-kubelet-config\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-hosts-file\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-cni-bin\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-ovnkube-config\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ggp\" (UniqueName: \"kubernetes.io/projected/19d829fa-efbb-4416-b352-1d9fc1a415a5-kube-api-access-n5ggp\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b688a809-9200-4960-8e1d-946f12916d5a-host\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3793790-6628-4fc7-b703-ea4a0b0d18d0-konnectivity-ca\") pod \"konnectivity-agent-7rlw2\" (UID: \"c3793790-6628-4fc7-b703-ea4a0b0d18d0\") " pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:34.630829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19d829fa-efbb-4416-b352-1d9fc1a415a5-tmp\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-registration-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-etc-kubernetes\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-k8s-cni-cncf-io\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.630945 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.630965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b688a809-9200-4960-8e1d-946f12916d5a-serviceca\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.631004 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:35.130983096 +0000 UTC m=+2.971302816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-var-lib-kubelet\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-etc-kubernetes\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-socket-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-conf-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-k8s-cni-cncf-io\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-var-lib-kubelet\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631145 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-registration-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-multus-certs\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.631411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-conf-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-multus-certs\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbd9p\" (UniqueName: \"kubernetes.io/projected/bab8d59a-b79e-4a46-a366-2a033873dbd6-kube-api-access-lbd9p\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631286 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-socket-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssln\" (UniqueName: \"kubernetes.io/projected/50f0b4be-fa84-441d-86aa-132e96a547dc-kube-api-access-jssln\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-slash\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631348 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-ovnkube-config\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-node-log\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-slash\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-ovnkube-script-lib\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-system-cni-dir\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-node-log\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsqs\" (UniqueName: \"kubernetes.io/projected/b688a809-9200-4960-8e1d-946f12916d5a-kube-api-access-qwsqs\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-systemd\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-run\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-host\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.632276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-systemd\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-device-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-sys-fs\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-cnibin\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631747 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-device-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-sys-fs\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-modprobe-d\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631820 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-run\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631794 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-host\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-cnibin\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-system-cni-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-cni-bin\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631927 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/5835a4eb-b89e-400c-827f-c7c9d554e259-kube-api-access-trn7n\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-modprobe-d\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.633200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3793790-6628-4fc7-b703-ea4a0b0d18d0-agent-certs\") pod \"konnectivity-agent-7rlw2\" (UID: \"c3793790-6628-4fc7-b703-ea4a0b0d18d0\") " pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-cni-bin\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.631985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-system-cni-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632034 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-ovnkube-script-lib\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-kubelet\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-run-netns\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2f54\" (UniqueName: \"kubernetes.io/projected/5a8d7bab-db41-40db-ba10-1d4faafff654-kube-api-access-j2f54\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-tmp-dir\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632188 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-run-netns\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-tuned\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-dbus\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-os-release\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-os-release\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-host-kubelet\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-dbus\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lccb\" (UniqueName: \"kubernetes.io/projected/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-kube-api-access-2lccb\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-tmp-dir\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632619 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-os-release\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634079 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-etc-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-etc-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632918 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.632908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-kubernetes\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysctl-conf\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633034 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-kubernetes\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-netns\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqcgd\" (UniqueName: \"kubernetes.io/projected/c2c025f9-945a-43b0-904d-f7e6d763c836-kube-api-access-dqcgd\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysctl-conf\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-daemon-config\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-cni-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.633227 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-run-netns\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-hostroot\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-cnibin\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.634957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5835a4eb-b89e-400c-827f-c7c9d554e259-iptables-alerter-script\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-systemd-units\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633516 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4x9\" (UniqueName: \"kubernetes.io/projected/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-kube-api-access-zv4x9\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-sys\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-hostroot\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-lib-modules\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-ovn\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-env-overrides\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8d7bab-db41-40db-ba10-1d4faafff654-ovn-node-metrics-cert\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysconfig\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysctl-d\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bab8d59a-b79e-4a46-a366-2a033873dbd6-cni-binary-copy\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-socket-dir-parent\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.635839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633895 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-daemon-config\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.633935 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:35.133917208 +0000 UTC m=+2.974236904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-ovn\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-systemd-units\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-socket-dir-parent\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-multus-cni-dir\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.633957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-cni-multus\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5835a4eb-b89e-400c-827f-c7c9d554e259-host-slash\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634040 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysconfig\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-systemd\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-lib-modules\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-var-lib-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-var-lib-openvswitch\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-log-socket\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-run-systemd\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634187 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-sysctl-d\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a8d7bab-db41-40db-ba10-1d4faafff654-log-socket\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.636619 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19d829fa-efbb-4416-b352-1d9fc1a415a5-sys\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-cni-multus\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bab8d59a-b79e-4a46-a366-2a033873dbd6-cni-binary-copy\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a8d7bab-db41-40db-ba10-1d4faafff654-env-overrides\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-kubelet\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.634914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bab8d59a-b79e-4a46-a366-2a033873dbd6-host-var-lib-kubelet\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.635562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19d829fa-efbb-4416-b352-1d9fc1a415a5-etc-tuned\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.637396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.635606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19d829fa-efbb-4416-b352-1d9fc1a415a5-tmp\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.637932 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.637914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8d7bab-db41-40db-ba10-1d4faafff654-ovn-node-metrics-cert\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.639671 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.639653 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:49:34.639906 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.639676 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:49:34.639906 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.639717 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:34.639906 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:34.639881 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:35.139863025 +0000 UTC m=+2.980182747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:34.642229 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.642027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ggp\" (UniqueName: \"kubernetes.io/projected/19d829fa-efbb-4416-b352-1d9fc1a415a5-kube-api-access-n5ggp\") pod \"tuned-k2x4c\" (UID: \"19d829fa-efbb-4416-b352-1d9fc1a415a5\") " pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.642229 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.642087 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 07:49:34.643517 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.643470 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lccb\" (UniqueName: \"kubernetes.io/projected/8f35a0c4-21d0-4fe3-a918-6cc300e12a31-kube-api-access-2lccb\") pod \"aws-ebs-csi-driver-node-rvm74\" (UID: \"8f35a0c4-21d0-4fe3-a918-6cc300e12a31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.644769 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.644744 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqcgd\" (UniqueName: \"kubernetes.io/projected/c2c025f9-945a-43b0-904d-f7e6d763c836-kube-api-access-dqcgd\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:34.645290 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.645269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2f54\" (UniqueName: \"kubernetes.io/projected/5a8d7bab-db41-40db-ba10-1d4faafff654-kube-api-access-j2f54\") pod \"ovnkube-node-cxknp\" (UID: \"5a8d7bab-db41-40db-ba10-1d4faafff654\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.648405 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.648335 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4x9\" (UniqueName: \"kubernetes.io/projected/619f7e1b-dc9c-4c67-8171-89c8d818fbe5-kube-api-access-zv4x9\") pod \"node-resolver-kth4k\" (UID: \"619f7e1b-dc9c-4c67-8171-89c8d818fbe5\") " pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.648405 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.648337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbd9p\" (UniqueName: \"kubernetes.io/projected/bab8d59a-b79e-4a46-a366-2a033873dbd6-kube-api-access-lbd9p\") pod \"multus-n6tkl\" (UID: \"bab8d59a-b79e-4a46-a366-2a033873dbd6\") " pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.695104 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.695079 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 07:49:34.736062 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5835a4eb-b89e-400c-827f-c7c9d554e259-host-slash\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.736164 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736164 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b688a809-9200-4960-8e1d-946f12916d5a-host\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.736164 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b688a809-9200-4960-8e1d-946f12916d5a-host\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.736296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5835a4eb-b89e-400c-827f-c7c9d554e259-host-slash\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.736296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3793790-6628-4fc7-b703-ea4a0b0d18d0-konnectivity-ca\") pod \"konnectivity-agent-7rlw2\" (UID: \"c3793790-6628-4fc7-b703-ea4a0b0d18d0\") " pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.736296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b688a809-9200-4960-8e1d-946f12916d5a-serviceca\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.736296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jssln\" (UniqueName: \"kubernetes.io/projected/50f0b4be-fa84-441d-86aa-132e96a547dc-kube-api-access-jssln\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-system-cni-dir\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsqs\" (UniqueName: \"kubernetes.io/projected/b688a809-9200-4960-8e1d-946f12916d5a-kube-api-access-qwsqs\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-system-cni-dir\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736470 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/5835a4eb-b89e-400c-827f-c7c9d554e259-kube-api-access-trn7n\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3793790-6628-4fc7-b703-ea4a0b0d18d0-agent-certs\") pod \"konnectivity-agent-7rlw2\" (UID: \"c3793790-6628-4fc7-b703-ea4a0b0d18d0\") " pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-os-release\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-cnibin\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5835a4eb-b89e-400c-827f-c7c9d554e259-iptables-alerter-script\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b688a809-9200-4960-8e1d-946f12916d5a-serviceca\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.736837 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736747 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3793790-6628-4fc7-b703-ea4a0b0d18d0-konnectivity-ca\") pod \"konnectivity-agent-7rlw2\" (UID: \"c3793790-6628-4fc7-b703-ea4a0b0d18d0\") " pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.737166 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-cnibin\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.737166 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736860 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.737166 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.736914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50f0b4be-fa84-441d-86aa-132e96a547dc-os-release\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.737314 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.737207 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5835a4eb-b89e-400c-827f-c7c9d554e259-iptables-alerter-script\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.737314 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.737294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.737726 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.737708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50f0b4be-fa84-441d-86aa-132e96a547dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.739157 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.739139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3793790-6628-4fc7-b703-ea4a0b0d18d0-agent-certs\") pod \"konnectivity-agent-7rlw2\" (UID: \"c3793790-6628-4fc7-b703-ea4a0b0d18d0\") " pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:34.744921 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.744863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsqs\" (UniqueName: \"kubernetes.io/projected/b688a809-9200-4960-8e1d-946f12916d5a-kube-api-access-qwsqs\") pod \"node-ca-k4p79\" (UID: \"b688a809-9200-4960-8e1d-946f12916d5a\") " pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.745200 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.745181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssln\" (UniqueName: \"kubernetes.io/projected/50f0b4be-fa84-441d-86aa-132e96a547dc-kube-api-access-jssln\") pod \"multus-additional-cni-plugins-xd69x\" (UID: \"50f0b4be-fa84-441d-86aa-132e96a547dc\") " pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.745303 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.745286 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/5835a4eb-b89e-400c-827f-c7c9d554e259-kube-api-access-trn7n\") pod \"iptables-alerter-6xmz6\" (UID: \"5835a4eb-b89e-400c-827f-c7c9d554e259\") " pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.818355 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.818323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" Jul 21 07:49:34.826216 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.826198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:34.836955 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.836934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" Jul 21 07:49:34.843912 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.843890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n6tkl" Jul 21 07:49:34.850669 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.850647 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kth4k" Jul 21 07:49:34.856646 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.856628 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xd69x" Jul 21 07:49:34.864370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.864351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6xmz6" Jul 21 07:49:34.870962 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.870946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4p79" Jul 21 07:49:34.876720 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:34.876697 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:35.139560 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.139481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:35.139560 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.139541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:35.139792 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.139660 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:35.139792 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.139719 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:36.139698732 +0000 UTC m=+3.980018429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:35.139792 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.139661 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:35.139947 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.139827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:36.139797472 +0000 UTC m=+3.980117182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:35.240744 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.240708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:35.240971 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.240901 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:49:35.240971 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.240928 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:49:35.240971 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.240942 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:35.241120 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.241010 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:36.24099186 +0000 UTC m=+4.081311578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:35.507924 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:35.507895 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d829fa_efbb_4416_b352_1d9fc1a415a5.slice/crio-b8d2737213c4fe8517bd2986cf8ee414fd4ff3540d4e5144692e7b6472af1d39 WatchSource:0}: Error finding container b8d2737213c4fe8517bd2986cf8ee414fd4ff3540d4e5144692e7b6472af1d39: Status 404 returned error can't find the container with id b8d2737213c4fe8517bd2986cf8ee414fd4ff3540d4e5144692e7b6472af1d39 Jul 21 07:49:35.511181 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:35.511147 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5835a4eb_b89e_400c_827f_c7c9d554e259.slice/crio-f460538d13188d3db8616fc03bf15a21f7c9788485f9dd4e223d575547a74489 WatchSource:0}: Error finding container f460538d13188d3db8616fc03bf15a21f7c9788485f9dd4e223d575547a74489: Status 404 returned error can't find the container with id f460538d13188d3db8616fc03bf15a21f7c9788485f9dd4e223d575547a74489 Jul 21 07:49:35.512680 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:35.512596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f35a0c4_21d0_4fe3_a918_6cc300e12a31.slice/crio-c693f663c1604039185eaea39b77142e47c9a0a30fdc5a981130e55bd0d28f7b WatchSource:0}: Error finding container c693f663c1604039185eaea39b77142e47c9a0a30fdc5a981130e55bd0d28f7b: Status 404 returned error can't find the container with id c693f663c1604039185eaea39b77142e47c9a0a30fdc5a981130e55bd0d28f7b Jul 21 07:49:35.513395 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:35.513369 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f0b4be_fa84_441d_86aa_132e96a547dc.slice/crio-c6019fcc27208e07e2ca566eca5a7b9090d1694a129667f0616f57e815dad522 WatchSource:0}: Error finding container c6019fcc27208e07e2ca566eca5a7b9090d1694a129667f0616f57e815dad522: Status 404 returned error can't find the container with id c6019fcc27208e07e2ca566eca5a7b9090d1694a129667f0616f57e815dad522 Jul 21 07:49:35.517107 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:49:35.517080 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb688a809_9200_4960_8e1d_946f12916d5a.slice/crio-9cd622518ab86df82afedec87be4f0af566b7fda2868e8b6325ef699c4a25f8f WatchSource:0}: Error finding container 9cd622518ab86df82afedec87be4f0af566b7fda2868e8b6325ef699c4a25f8f: Status 404 returned error can't find the container with id 9cd622518ab86df82afedec87be4f0af566b7fda2868e8b6325ef699c4a25f8f Jul 21 07:49:35.559472 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.559445 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 07:44:34 +0000 UTC" deadline="2028-05-01 08:22:10.386895904 +0000 UTC" Jul 21 07:49:35.559472 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.559471 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15600h32m34.827427998s" Jul 21 07:49:35.646756 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.646729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:35.646876 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:35.646858 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:35.654933 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.654906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" event={"ID":"9e5bd059099eaa7be4523cc656d99f14","Type":"ContainerStarted","Data":"5f08a2b6f095c92cf11877efc0bd781e1b95d505f7c5accbba9ec106187b9529"} Jul 21 07:49:35.656097 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.656077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rlw2" event={"ID":"c3793790-6628-4fc7-b703-ea4a0b0d18d0","Type":"ContainerStarted","Data":"fcd712f9297bf38250a63be89249fe2c83c4e3589d4577dd0af492b994fc4983"} Jul 21 07:49:35.657234 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.657214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" event={"ID":"8f35a0c4-21d0-4fe3-a918-6cc300e12a31","Type":"ContainerStarted","Data":"c693f663c1604039185eaea39b77142e47c9a0a30fdc5a981130e55bd0d28f7b"} Jul 21 07:49:35.658551 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.658529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6xmz6" event={"ID":"5835a4eb-b89e-400c-827f-c7c9d554e259","Type":"ContainerStarted","Data":"f460538d13188d3db8616fc03bf15a21f7c9788485f9dd4e223d575547a74489"} Jul 21 07:49:35.659648 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.659627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" event={"ID":"19d829fa-efbb-4416-b352-1d9fc1a415a5","Type":"ContainerStarted","Data":"b8d2737213c4fe8517bd2986cf8ee414fd4ff3540d4e5144692e7b6472af1d39"} Jul 21 07:49:35.660772 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.660753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"fc8e762616207417aa59d9e144ec7bcdc42e9c3b806d18607d8ddc8ea1aed746"} Jul 21 07:49:35.661946 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.661920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n6tkl" event={"ID":"bab8d59a-b79e-4a46-a366-2a033873dbd6","Type":"ContainerStarted","Data":"cf8704a479c3ba90204e9551d504522d2bb283aefffdaefd8d0c735dd6e7cb38"} Jul 21 07:49:35.663160 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.663141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4p79" event={"ID":"b688a809-9200-4960-8e1d-946f12916d5a","Type":"ContainerStarted","Data":"9cd622518ab86df82afedec87be4f0af566b7fda2868e8b6325ef699c4a25f8f"} Jul 21 07:49:35.664267 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.664243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kth4k" event={"ID":"619f7e1b-dc9c-4c67-8171-89c8d818fbe5","Type":"ContainerStarted","Data":"11d16ddbe42497a3c2d5edd19c83918b39d45028549ccb06995d8be6de1a2fb6"} Jul 21 07:49:35.665622 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.665586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerStarted","Data":"c6019fcc27208e07e2ca566eca5a7b9090d1694a129667f0616f57e815dad522"} Jul 21 07:49:35.668414 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:35.668363 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" podStartSLOduration=1.6683527 podStartE2EDuration="1.6683527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:35.668256144 +0000 UTC m=+3.508575862" watchObservedRunningTime="2026-07-21 07:49:35.6683527 +0000 UTC m=+3.508672418" Jul 21 07:49:36.147661 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.147160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:36.147661 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.147527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:36.147911 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.147422 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:36.147911 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.147745 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:38.147723945 +0000 UTC m=+5.988043642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:36.148166 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.147679 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:36.148238 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.148215 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:38.148196314 +0000 UTC m=+5.988516012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:36.250824 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.250771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:36.251010 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.250992 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:49:36.251068 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.251019 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:49:36.251068 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.251034 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:36.251189 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.251094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:38.251075325 +0000 UTC m=+6.091395024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:36.559796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.559618 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 07:44:34 +0000 UTC" deadline="2028-02-19 04:10:13.797701246 +0000 UTC" Jul 21 07:49:36.559796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.559702 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13868h20m37.238003942s" Jul 21 07:49:36.647978 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.647938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:36.648148 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.648092 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:36.648402 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.647943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:36.648402 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:36.648363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:36.681887 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.681854 2578 generic.go:356] "Generic (PLEG): container finished" podID="f13e66237d3916f0afcf9e2c5198acae" containerID="d3c3b20c97c26e5a28b66e6f792ce1d370373e7bb4c6aaa1d888cd9f9a945cc6" exitCode=0 Jul 21 07:49:36.682029 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:36.681906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" event={"ID":"f13e66237d3916f0afcf9e2c5198acae","Type":"ContainerDied","Data":"d3c3b20c97c26e5a28b66e6f792ce1d370373e7bb4c6aaa1d888cd9f9a945cc6"} Jul 21 07:49:37.646822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:37.646774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:37.647348 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:37.646898 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:37.689525 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:37.689485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" event={"ID":"f13e66237d3916f0afcf9e2c5198acae","Type":"ContainerStarted","Data":"488343fcbcd6987ca9e526674cfddbc7763554879b50d711d9130e2f873c38ef"} Jul 21 07:49:38.167857 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:38.167010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:38.167857 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:38.167095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:38.167857 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.167270 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:38.167857 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.167348 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:42.16732538 +0000 UTC m=+10.007645076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:38.167857 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.167752 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:38.167857 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.167804 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:42.167787978 +0000 UTC m=+10.008107676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:38.268977 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:38.268300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:38.268977 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.268530 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:49:38.268977 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.268550 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:49:38.268977 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.268565 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:38.268977 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.268641 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:42.268603022 +0000 UTC m=+10.108922736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:38.647939 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:38.647864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:38.647939 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:38.647880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:38.648463 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.648026 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:38.648553 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:38.648513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:39.647041 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:39.646553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:39.647041 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:39.646687 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:40.646516 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:40.646486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:40.646965 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:40.646617 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:40.646965 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:40.646484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:40.647082 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:40.647058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:41.646516 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:41.646480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:41.646984 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:41.646631 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:42.200180 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:42.200146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:42.200360 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:42.200212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:42.200360 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.200291 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:42.200360 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.200347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:50.200329772 +0000 UTC m=+18.040649478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:42.200472 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.200291 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:42.200472 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.200448 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:50.200426243 +0000 UTC m=+18.040745952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:42.300884 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:42.300850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:42.301032 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.301017 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:49:42.301089 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.301042 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:49:42.301089 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.301055 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:42.301187 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.301105 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:49:50.301088251 +0000 UTC m=+18.141407959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:42.648190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:42.647684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:42.648190 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.647819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:42.648190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:42.647871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:42.648190 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:42.647979 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:43.646614 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:43.646483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:43.646614 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:43.646608 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:44.646739 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:44.646602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:44.647177 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:44.646764 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:44.647177 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:44.646821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:44.647177 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:44.646907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:45.646937 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:45.646911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:45.647310 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:45.647013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:46.646338 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:46.646310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:46.646514 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:46.646311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:46.646514 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:46.646424 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:46.646623 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:46.646520 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:47.646993 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:47.646956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:47.647409 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:47.647077 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:48.649308 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:48.649281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:48.649716 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:48.649394 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:48.649716 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:48.649454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:48.649716 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:48.649555 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:49.646460 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:49.646430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:49.646633 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:49.646526 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:50.261509 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:50.261468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:50.262048 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:50.261525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:50.262048 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.261633 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:50.262048 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.261695 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:06.261674967 +0000 UTC m=+34.101994660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:49:50.262048 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.261633 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:50.262048 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.261757 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:06.261746853 +0000 UTC m=+34.102066552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:49:50.362286 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:50.362246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:50.362464 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.362414 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:49:50.362464 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.362442 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:49:50.362464 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.362456 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:50.362585 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.362509 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:06.362496171 +0000 UTC m=+34.202815864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:49:50.647171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:50.647072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:50.647336 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.647224 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:50.647336 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:50.647266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:50.647455 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:50.647333 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:51.646432 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:51.646403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:51.646850 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:51.646508 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:52.647884 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:52.647854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:52.648324 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:52.647942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:52.648324 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:52.647963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:52.648324 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:52.648043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:53.646504 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:53.646470 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:53.646662 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:53.646574 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:54.647021 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.646812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:54.647850 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.646812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:54.647850 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:54.647131 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:54.647850 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:54.647172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:54.723617 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.723596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"27966f93a14ceeabf3928b7eae2eb50dbdcf404ed6fc3a29a2ebc802a0a7fdca"} Jul 21 07:49:54.723700 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.723654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"e1a539631bc09bf3ca52b514b91f2b021ae2490a16eee231c058d96f337161d4"} Jul 21 07:49:54.723700 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.723695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"e5d57bfcbec285b536ea53a1794052157ca1ad93c796672421b7943369ac74e0"} Jul 21 07:49:54.723803 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.723749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"6664ddc4746c3a8d542e612ed2d395e3557dbccb4636cc82bde379f0dc045226"} Jul 21 07:49:54.724975 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.724925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n6tkl" event={"ID":"bab8d59a-b79e-4a46-a366-2a033873dbd6","Type":"ContainerStarted","Data":"1a229d6120a878f22cf032f31a795ddcc034a48d3ffef44972cc24cc3f8b53af"} Jul 21 07:49:54.726159 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.726136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4p79" event={"ID":"b688a809-9200-4960-8e1d-946f12916d5a","Type":"ContainerStarted","Data":"59439f9bb9051c9a8bf2caf8a9c62eed3a5f25f1f247d2d5d66757eaf8096010"} Jul 21 07:49:54.727399 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.727379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kth4k" event={"ID":"619f7e1b-dc9c-4c67-8171-89c8d818fbe5","Type":"ContainerStarted","Data":"22fa075038c3c437cae5beb541e3b2fa8adf34122a353ed00868b1ea5d69c292"} Jul 21 07:49:54.728760 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.728722 2578 generic.go:356] "Generic (PLEG): container finished" podID="50f0b4be-fa84-441d-86aa-132e96a547dc" containerID="e85d845d880fee7cdf0743a30e4301758e2b781651ef6cae01c67db11d2115da" exitCode=0 Jul 21 07:49:54.728844 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.728815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerDied","Data":"e85d845d880fee7cdf0743a30e4301758e2b781651ef6cae01c67db11d2115da"} Jul 21 07:49:54.730308 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.730283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rlw2" event={"ID":"c3793790-6628-4fc7-b703-ea4a0b0d18d0","Type":"ContainerStarted","Data":"1cee6b4265aedf3d187915685f5cca1d1f9c6d8b14ca7ea16e079fadc72cd786"} Jul 21 07:49:54.731829 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.731802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" event={"ID":"8f35a0c4-21d0-4fe3-a918-6cc300e12a31","Type":"ContainerStarted","Data":"261a9a818fa2e47fc242f49066a872292d679a653242b645b87e7bfeefe37dcc"} Jul 21 07:49:54.733143 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.733123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" event={"ID":"19d829fa-efbb-4416-b352-1d9fc1a415a5","Type":"ContainerStarted","Data":"544baaf5777157ac3ed08c95120338808b2744b5d23eb68e0fc115e3f5140730"} Jul 21 07:49:54.747924 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.747703 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n6tkl" podStartSLOduration=3.069983634 podStartE2EDuration="21.74769267s" totalImagesPullingTime="18.677709036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:54.746249379 +0000 UTC m=+22.586569096" watchObservedRunningTime="2026-07-21 07:49:54.74769267 +0000 UTC m=+22.588012386" Jul 21 07:49:54.748191 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.748170 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" podStartSLOduration=20.748161742 podStartE2EDuration="20.748161742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:37.706417947 +0000 UTC m=+5.546737666" watchObservedRunningTime="2026-07-21 07:49:54.748161742 +0000 UTC m=+22.588481488" Jul 21 07:49:54.771393 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.771352 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kth4k" podStartSLOduration=3.126825137 podStartE2EDuration="21.771334521s" totalImagesPullingTime="18.644509384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:54.770624813 +0000 UTC m=+22.610944529" watchObservedRunningTime="2026-07-21 07:49:54.771334521 +0000 UTC m=+22.611654239" Jul 21 07:49:54.806077 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.806043 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7rlw2" podStartSLOduration=11.396898136 podStartE2EDuration="21.806025113s" totalImagesPullingTime="10.409126977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:54.805952467 +0000 UTC m=+22.646272182" watchObservedRunningTime="2026-07-21 07:49:54.806025113 +0000 UTC m=+22.646344829" Jul 21 07:49:54.820213 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.820181 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k4p79" podStartSLOduration=3.15583955 podStartE2EDuration="21.820169025s" totalImagesPullingTime="18.664329475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:54.819775463 +0000 UTC m=+22.660095179" watchObservedRunningTime="2026-07-21 07:49:54.820169025 +0000 UTC m=+22.660488769" Jul 21 07:49:54.838941 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.838912 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k2x4c" podStartSLOduration=3.162304592 podStartE2EDuration="21.838900581s" totalImagesPullingTime="18.676595989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:54.838588858 +0000 UTC m=+22.678908580" watchObservedRunningTime="2026-07-21 07:49:54.838900581 +0000 UTC m=+22.679220299" Jul 21 07:49:54.926800 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:54.926774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:55.008827 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.008722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:55.646817 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.646795 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:55.646933 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:55.646896 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:55.737323 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.737291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6xmz6" event={"ID":"5835a4eb-b89e-400c-827f-c7c9d554e259","Type":"ContainerStarted","Data":"1fa1ad2e4dcbfe8269e3fd15cb329400fde0f560a0000d0230be065f0b159c84"} Jul 21 07:49:55.742596 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.742568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"62c2517a7464bfa76de31e29440196259c2d1170b74ea3a55c609ab5baaf5764"} Jul 21 07:49:55.742718 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.742649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"bfc2fd72f1a879ca21ffe63091728dce692afaf6c5db0e69f15149b9bc6bab86"} Jul 21 07:49:55.751171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.751118 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6xmz6" podStartSLOduration=4.079472311 podStartE2EDuration="22.751102297s" totalImagesPullingTime="18.671629986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:55.750963409 +0000 UTC m=+23.591283126" watchObservedRunningTime="2026-07-21 07:49:55.751102297 +0000 UTC m=+23.591422015" Jul 21 07:49:55.785407 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.785386 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 07:49:55.868685 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.868649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:55.947333 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:55.947290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:56.585078 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:56.584990 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T07:49:55.785402635Z","UUID":"6125467e-08fb-45dd-8bcc-8c57f767da69","Handler":null,"Name":"","Endpoint":""} Jul 21 07:49:56.586896 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:56.586875 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 07:49:56.587101 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:56.586910 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 07:49:56.647217 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:56.647187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:56.647217 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:56.647207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:56.647499 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:56.647299 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:56.647499 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:56.647396 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:56.754220 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:56.754162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" event={"ID":"8f35a0c4-21d0-4fe3-a918-6cc300e12a31","Type":"ContainerStarted","Data":"a58269e0f158aa6f14062326c3b2beb286f9f5aefd395b7bda48ce863969354b"} Jul 21 07:49:57.221475 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:57.221407 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:57.222066 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:57.222041 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:57.647058 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:57.646992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:57.647273 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:57.647091 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:57.763812 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:57.763762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"28172e8e3a720f08517825315801cda87a4a802ea5f63c619867cdc6caac06d6"} Jul 21 07:49:57.766340 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:57.766300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" event={"ID":"8f35a0c4-21d0-4fe3-a918-6cc300e12a31","Type":"ContainerStarted","Data":"d52d67ad11c9c3b090745564960efa4bd6faa97ac0eb3e2c6171f891cdbc02bf"} Jul 21 07:49:57.782657 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:57.782610 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvm74" podStartSLOduration=3.7963484469999997 podStartE2EDuration="24.782594487s" totalImagesPullingTime="20.98624604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:57.782213811 +0000 UTC m=+25.622533541" watchObservedRunningTime="2026-07-21 07:49:57.782594487 +0000 UTC m=+25.622914204" Jul 21 07:49:58.011527 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.011446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:58.012115 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.012092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7rlw2" Jul 21 07:49:58.069948 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.069919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:58.627961 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.627926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:58.646925 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.646889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:49:58.647067 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:58.647018 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:49:58.647131 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.647079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:49:58.647213 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:58.647189 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:49:58.728626 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:58.728572 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:49:59.647490 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.647301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:49:59.648082 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:49:59.647528 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:49:59.773847 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.773816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" event={"ID":"5a8d7bab-db41-40db-ba10-1d4faafff654","Type":"ContainerStarted","Data":"de75a0431852115631bd449bf0b19576df2778b13ed40cb88d083375e35156cf"} Jul 21 07:49:59.774059 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.774039 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:59.774163 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.774111 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:59.775930 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.775906 2578 generic.go:356] "Generic (PLEG): container finished" podID="50f0b4be-fa84-441d-86aa-132e96a547dc" containerID="8fa47e826ffed26225e58a4598b11a9ef928b8a2cac617197f19ce8500d523e3" exitCode=0 Jul 21 07:49:59.776043 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.775989 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerDied","Data":"8fa47e826ffed26225e58a4598b11a9ef928b8a2cac617197f19ce8500d523e3"} Jul 21 07:49:59.789835 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.789814 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:59.790183 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.790170 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:49:59.800860 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:49:59.800825 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" podStartSLOduration=8.053701663 podStartE2EDuration="26.800813064s" totalImagesPullingTime="18.747111401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:49:59.800612576 +0000 UTC m=+27.640932292" watchObservedRunningTime="2026-07-21 07:49:59.800813064 +0000 UTC m=+27.641132808" Jul 21 07:50:00.647652 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:00.647390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:00.648121 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:00.647421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:00.648121 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:00.647800 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:50:00.648121 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:00.647936 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:50:00.778098 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:00.778079 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 21 07:50:01.158429 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.158403 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgxlv"] Jul 21 07:50:01.158564 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.158486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:01.158604 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:01.158563 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:50:01.162535 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.162511 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tc2b5"] Jul 21 07:50:01.162660 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.162622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:01.162750 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:01.162719 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:50:01.163209 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.163186 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8w8j"] Jul 21 07:50:01.163306 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.163257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:01.163442 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:01.163328 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:50:01.356446 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.356381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:01.450543 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.450509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:01.521297 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.521268 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:50:01.550291 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.550257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:01.782236 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.782170 2578 generic.go:356] "Generic (PLEG): container finished" podID="50f0b4be-fa84-441d-86aa-132e96a547dc" containerID="1fc954c430d79f7f0e92482db4ec50e26240ddda85123b4349fd801ab6cc33c5" exitCode=0 Jul 21 07:50:01.782690 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:01.782267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerDied","Data":"1fc954c430d79f7f0e92482db4ec50e26240ddda85123b4349fd801ab6cc33c5"} Jul 21 07:50:02.647434 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:02.647399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:02.647654 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:02.647481 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:50:02.647654 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:02.647523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:02.647654 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:02.647567 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:50:02.647654 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:02.647595 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:02.647654 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:02.647634 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:50:03.790694 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:03.790504 2578 generic.go:356] "Generic (PLEG): container finished" podID="50f0b4be-fa84-441d-86aa-132e96a547dc" containerID="25cd0aa6e794295f54db130473a5d6b6fc73f253c3f39f7930dc9807baff4c86" exitCode=0 Jul 21 07:50:03.790694 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:03.790619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerDied","Data":"25cd0aa6e794295f54db130473a5d6b6fc73f253c3f39f7930dc9807baff4c86"} Jul 21 07:50:04.088260 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.088195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:04.190466 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.190439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:04.646856 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.646823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:04.646856 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.646837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:04.647086 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:04.646946 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:50:04.647086 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:04.647023 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:50:04.647086 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.647046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:04.647230 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:04.647142 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:50:04.841897 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.841868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:04.942265 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:04.942189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:05.143460 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:05.143421 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:05.198145 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:05.198070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:05.953421 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:05.953385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:06.010838 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.010812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:06.285885 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.285813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:06.285885 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.285866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:06.286088 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.285943 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:50:06.286088 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.285962 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 07:50:06.286088 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.286022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:38.28599969 +0000 UTC m=+66.126319401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 07:50:06.286088 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.286045 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret podName:682bcf3d-f2f6-4fd8-aac1-4b63509436d9 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:38.286034443 +0000 UTC m=+66.126354144 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret") pod "global-pull-secret-syncer-tc2b5" (UID: "682bcf3d-f2f6-4fd8-aac1-4b63509436d9") : object "kube-system"/"original-pull-secret" not registered Jul 21 07:50:06.386550 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.386525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:06.386700 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.386625 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 07:50:06.386700 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.386638 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 07:50:06.386700 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.386647 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fn8g7 for pod openshift-network-diagnostics/network-check-target-qgxlv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:50:06.386700 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.386695 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7 podName:3ee22c0f-b518-40c6-a2e5-07800c1ef759 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:38.386675205 +0000 UTC m=+66.226994899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn8g7" (UniqueName: "kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7") pod "network-check-target-qgxlv" (UID: "3ee22c0f-b518-40c6-a2e5-07800c1ef759") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 07:50:06.646488 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.646415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:06.646488 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.646442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:06.646488 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:06.646475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:06.646813 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.646590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:50:06.646813 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.646698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgxlv" podUID="3ee22c0f-b518-40c6-a2e5-07800c1ef759" Jul 21 07:50:06.646813 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:06.646745 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc2b5" podUID="682bcf3d-f2f6-4fd8-aac1-4b63509436d9" Jul 21 07:50:07.943190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.943129 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeReady" Jul 21 07:50:07.943660 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.943226 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 07:50:07.976276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.976251 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-598546d87d-5pr88"] Jul 21 07:50:07.985393 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.985375 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:07.988087 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.988067 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 07:50:07.988187 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.988073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gl75q\"" Jul 21 07:50:07.988187 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.988093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 07:50:07.988187 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.988170 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vvbpl"] Jul 21 07:50:07.988326 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.988224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 07:50:07.998407 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:07.998386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 07:50:08.012663 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.012646 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v8trp"] Jul 21 07:50:08.012803 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.012786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.015389 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.015354 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9mgdw\"" Jul 21 07:50:08.015389 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.015374 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 07:50:08.015389 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.015384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 07:50:08.015556 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.015446 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 07:50:08.027695 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.027676 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-598546d87d-5pr88"] Jul 21 07:50:08.027801 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.027707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v8trp"] Jul 21 07:50:08.027801 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.027758 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvbpl"] Jul 21 07:50:08.027902 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.027847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.030036 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.030009 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 07:50:08.030129 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.030041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 07:50:08.030129 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.030057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wt7l9\"" Jul 21 07:50:08.099459 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099554 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-image-registry-private-configuration\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099554 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-certificates\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099554 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-installation-pull-secrets\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099714 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-trusted-ca\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099714 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-bound-sa-token\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099714 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95758bf1-3f57-4f78-8c89-aaf92936fb56-ca-trust-extracted\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.099714 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.099699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh8bg\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-kube-api-access-kh8bg\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.105852 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.105832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:08.200598 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/88edd8f7-ade8-4af6-b44f-5ec67f59e4c4-kube-api-access-972lb\") pod \"ingress-canary-vvbpl\" (UID: \"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4\") " pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.200678 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.200678 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e73dfe6-a2be-483a-b9dc-86fa373709e0-tmp-dir\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.200678 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-image-registry-private-configuration\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.200678 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73dfe6-a2be-483a-b9dc-86fa373709e0-config-volume\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.200889 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-certificates\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.200889 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-installation-pull-secrets\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.200985 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-trusted-ca\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201037 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.200981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-bound-sa-token\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201091 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95758bf1-3f57-4f78-8c89-aaf92936fb56-ca-trust-extracted\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201091 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh8bg\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-kube-api-access-kh8bg\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201181 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6bd\" (UniqueName: \"kubernetes.io/projected/1e73dfe6-a2be-483a-b9dc-86fa373709e0-kube-api-access-4g6bd\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.201181 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88edd8f7-ade8-4af6-b44f-5ec67f59e4c4-cert\") pod \"ingress-canary-vvbpl\" (UID: \"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4\") " pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.201181 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201335 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.201300 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:08.201335 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.201313 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:08.201413 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.201360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:08.701342173 +0000 UTC m=+36.541661872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:08.201517 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-certificates\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201791 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95758bf1-3f57-4f78-8c89-aaf92936fb56-ca-trust-extracted\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.201864 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.201852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-trusted-ca\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.204518 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.204498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-image-registry-private-configuration\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.204592 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.204500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-installation-pull-secrets\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.214245 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.214218 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-bound-sa-token\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.214339 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.214307 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh8bg\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-kube-api-access-kh8bg\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.302435 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6bd\" (UniqueName: \"kubernetes.io/projected/1e73dfe6-a2be-483a-b9dc-86fa373709e0-kube-api-access-4g6bd\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.302491 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88edd8f7-ade8-4af6-b44f-5ec67f59e4c4-cert\") pod \"ingress-canary-vvbpl\" (UID: \"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4\") " pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.302549 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/88edd8f7-ade8-4af6-b44f-5ec67f59e4c4-kube-api-access-972lb\") pod \"ingress-canary-vvbpl\" (UID: \"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4\") " pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.302586 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.302586 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e73dfe6-a2be-483a-b9dc-86fa373709e0-tmp-dir\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.302693 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73dfe6-a2be-483a-b9dc-86fa373709e0-config-volume\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.302772 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.302699 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:08.302827 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.302772 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:08.80275218 +0000 UTC m=+36.643071888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:08.302996 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.302964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e73dfe6-a2be-483a-b9dc-86fa373709e0-tmp-dir\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.303217 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.303200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e73dfe6-a2be-483a-b9dc-86fa373709e0-config-volume\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.304646 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.304622 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88edd8f7-ade8-4af6-b44f-5ec67f59e4c4-cert\") pod \"ingress-canary-vvbpl\" (UID: \"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4\") " pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.310562 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.310538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6bd\" (UniqueName: \"kubernetes.io/projected/1e73dfe6-a2be-483a-b9dc-86fa373709e0-kube-api-access-4g6bd\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.310778 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.310760 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-972lb\" (UniqueName: \"kubernetes.io/projected/88edd8f7-ade8-4af6-b44f-5ec67f59e4c4-kube-api-access-972lb\") pod \"ingress-canary-vvbpl\" (UID: \"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4\") " pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.320574 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.320555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvbpl" Jul 21 07:50:08.440808 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.440773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvbpl"] Jul 21 07:50:08.444964 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:50:08.444938 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88edd8f7_ade8_4af6_b44f_5ec67f59e4c4.slice/crio-c6244ddee49ac3ab0f1eeeb73c270d0bc40253dcbac45cf00a46a26ac1bdb523 WatchSource:0}: Error finding container c6244ddee49ac3ab0f1eeeb73c270d0bc40253dcbac45cf00a46a26ac1bdb523: Status 404 returned error can't find the container with id c6244ddee49ac3ab0f1eeeb73c270d0bc40253dcbac45cf00a46a26ac1bdb523 Jul 21 07:50:08.646826 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.646802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:08.646940 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.646924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:08.646995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.646802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:08.649832 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.649809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 07:50:08.649832 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.649824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jzhwt\"" Jul 21 07:50:08.650025 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.649879 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gpmnn\"" Jul 21 07:50:08.650095 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.650077 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 07:50:08.650135 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.650101 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 07:50:08.650174 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.650077 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 07:50:08.705139 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.705099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:08.705221 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.705202 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:08.705221 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.705212 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:08.705296 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.705256 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:09.705242245 +0000 UTC m=+37.545561940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:08.802895 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.802870 2578 generic.go:356] "Generic (PLEG): container finished" podID="50f0b4be-fa84-441d-86aa-132e96a547dc" containerID="0806c38c2b428c96ec3263e5009c18b3d23af8df31f9576614f195c43007289a" exitCode=0 Jul 21 07:50:08.802990 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.802946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerDied","Data":"0806c38c2b428c96ec3263e5009c18b3d23af8df31f9576614f195c43007289a"} Jul 21 07:50:08.804039 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.804014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvbpl" event={"ID":"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4","Type":"ContainerStarted","Data":"c6244ddee49ac3ab0f1eeeb73c270d0bc40253dcbac45cf00a46a26ac1bdb523"} Jul 21 07:50:08.805332 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:08.805311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:08.805478 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.805398 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:08.805478 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:08.805452 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:09.805434113 +0000 UTC m=+37.645753807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:09.108807 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:09.108740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:09.712851 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:09.712810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:09.713001 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:09.712951 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:09.713001 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:09.712974 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:09.713104 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:09.713041 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:11.713022073 +0000 UTC m=+39.553341780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:09.810845 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:09.810801 2578 generic.go:356] "Generic (PLEG): container finished" podID="50f0b4be-fa84-441d-86aa-132e96a547dc" containerID="0e015e8adcd889d121ecc890f2d2931d53fa11c441f15a7576759b453004f1df" exitCode=0 Jul 21 07:50:09.811035 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:09.810875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerDied","Data":"0e015e8adcd889d121ecc890f2d2931d53fa11c441f15a7576759b453004f1df"} Jul 21 07:50:09.813215 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:09.813191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:09.813373 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:09.813334 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:09.813478 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:09.813398 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:11.813377402 +0000 UTC m=+39.653697100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:10.817049 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:10.817016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xd69x" event={"ID":"50f0b4be-fa84-441d-86aa-132e96a547dc","Type":"ContainerStarted","Data":"8836f9adcf0e6d62883bec3135d529067f5a44fa98413127e79ab795e6e0e4a5"} Jul 21 07:50:10.839458 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:10.839400 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xd69x" podStartSLOduration=8.011530131 podStartE2EDuration="37.839379854s" totalImagesPullingTime="29.827849723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:50:10.837136993 +0000 UTC m=+38.677456710" watchObservedRunningTime="2026-07-21 07:50:10.839379854 +0000 UTC m=+38.679699572" Jul 21 07:50:10.958613 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:10.958573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:11.038532 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:11.038452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:11.308453 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:11.308153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:11.729783 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:11.729689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:11.729922 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:11.729837 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:11.729922 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:11.729856 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:11.729922 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:11.729913 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:15.729895644 +0000 UTC m=+43.570215343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:11.820753 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:11.820711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvbpl" event={"ID":"88edd8f7-ade8-4af6-b44f-5ec67f59e4c4","Type":"ContainerStarted","Data":"4a5524fd84a0f5685b9d0bdde3f8d8e3e008f43a7abd46f561a06987ef3366c5"} Jul 21 07:50:11.831040 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:11.831017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:11.831151 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:11.831103 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:11.831151 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:11.831144 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:15.831131882 +0000 UTC m=+43.671451577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:11.836813 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:11.836766 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vvbpl" podStartSLOduration=2.170511864 podStartE2EDuration="4.836751769s" totalImagesPullingTime="2.666239905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:50:11.836485916 +0000 UTC m=+39.676805635" watchObservedRunningTime="2026-07-21 07:50:11.836751769 +0000 UTC m=+39.677071478" Jul 21 07:50:15.756823 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:15.756789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:15.757190 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:15.756912 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:15.757190 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:15.756924 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:15.757190 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:15.756973 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:23.75695905 +0000 UTC m=+51.597278744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:15.841313 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:15.841276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:15.857269 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:15.857246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:15.857373 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:15.857351 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:15.857412 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:15.857397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:23.857383548 +0000 UTC m=+51.697703241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:15.941167 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:15.941141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:16.048644 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:16.048593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:23.807309 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:23.807276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:23.807827 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:23.807382 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:23.807827 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:23.807393 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:23.807827 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:23.807448 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:39.807432329 +0000 UTC m=+67.647752022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:23.908314 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:23.908284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:23.908431 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:23.908414 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:23.908479 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:23.908472 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:50:39.908458745 +0000 UTC m=+67.748778438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:32.438688 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:32.438643 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:32.502174 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:32.502131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:32.793839 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:32.793782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxknp" Jul 21 07:50:32.945093 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:32.945066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:33.046505 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:33.046438 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:35.949895 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:35.949864 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:36.051074 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:36.051051 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:38.303220 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.303180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:38.303583 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.303244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:50:38.305752 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.305715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 07:50:38.305800 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.305774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 07:50:38.313890 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:38.313871 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 07:50:38.313958 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:38.313937 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:51:42.313920686 +0000 UTC m=+130.154240382 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : secret "metrics-daemon-secret" not found Jul 21 07:50:38.317398 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.317375 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/682bcf3d-f2f6-4fd8-aac1-4b63509436d9-original-pull-secret\") pod \"global-pull-secret-syncer-tc2b5\" (UID: \"682bcf3d-f2f6-4fd8-aac1-4b63509436d9\") " pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:38.362741 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.362703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc2b5" Jul 21 07:50:38.403960 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.403929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:38.406494 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.406473 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 07:50:38.416903 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.416683 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 07:50:38.427877 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.427854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8g7\" (UniqueName: \"kubernetes.io/projected/3ee22c0f-b518-40c6-a2e5-07800c1ef759-kube-api-access-fn8g7\") pod \"network-check-target-qgxlv\" (UID: \"3ee22c0f-b518-40c6-a2e5-07800c1ef759\") " pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:38.474183 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.474158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tc2b5"] Jul 21 07:50:38.477220 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:50:38.477196 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682bcf3d_f2f6_4fd8_aac1_4b63509436d9.slice/crio-9f5bc9447c148aeba6824402abea550bb9a72ceab7a18a3f44aa056718ad81bd WatchSource:0}: Error finding container 9f5bc9447c148aeba6824402abea550bb9a72ceab7a18a3f44aa056718ad81bd: Status 404 returned error can't find the container with id 9f5bc9447c148aeba6824402abea550bb9a72ceab7a18a3f44aa056718ad81bd Jul 21 07:50:38.659805 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.659776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jzhwt\"" Jul 21 07:50:38.667628 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.667612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:38.778527 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.778501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgxlv"] Jul 21 07:50:38.781736 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:50:38.781700 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee22c0f_b518_40c6_a2e5_07800c1ef759.slice/crio-3a22162dc5861d15e8dad8de6a502674884651146fb94ab7932f5f9d1c7a92bb WatchSource:0}: Error finding container 3a22162dc5861d15e8dad8de6a502674884651146fb94ab7932f5f9d1c7a92bb: Status 404 returned error can't find the container with id 3a22162dc5861d15e8dad8de6a502674884651146fb94ab7932f5f9d1c7a92bb Jul 21 07:50:38.878227 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.878199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgxlv" event={"ID":"3ee22c0f-b518-40c6-a2e5-07800c1ef759","Type":"ContainerStarted","Data":"3a22162dc5861d15e8dad8de6a502674884651146fb94ab7932f5f9d1c7a92bb"} Jul 21 07:50:38.879208 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:38.879188 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tc2b5" event={"ID":"682bcf3d-f2f6-4fd8-aac1-4b63509436d9","Type":"ContainerStarted","Data":"9f5bc9447c148aeba6824402abea550bb9a72ceab7a18a3f44aa056718ad81bd"} Jul 21 07:50:39.814860 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:39.814826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:50:39.815401 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:39.814974 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:50:39.815401 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:39.814990 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:50:39.815401 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:39.815061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:51:11.815042277 +0000 UTC m=+99.655361991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:50:39.916031 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:39.915900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:50:39.916180 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:39.916046 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:50:39.916180 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:50:39.916120 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:51:11.916099368 +0000 UTC m=+99.756419066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:50:42.546080 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:42.546038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:42.646151 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:42.646119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:42.698052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:42.698022 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:50:43.893445 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:43.893360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgxlv" event={"ID":"3ee22c0f-b518-40c6-a2e5-07800c1ef759","Type":"ContainerStarted","Data":"61ce92a226a1ac2236fb39edd847a68e7e98ba5d6b018460b410bd6493de4bbf"} Jul 21 07:50:43.893445 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:43.893441 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:50:43.894813 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:43.894788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tc2b5" event={"ID":"682bcf3d-f2f6-4fd8-aac1-4b63509436d9","Type":"ContainerStarted","Data":"59505fcd866eca3d0c1a0e9f08fd01889c8c52427727e9b187035303e17fe875"} Jul 21 07:50:43.908716 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:50:43.908674 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qgxlv" podStartSLOduration=66.230153938 podStartE2EDuration="1m10.908662675s" totalImagesPullingTime="4.678508737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:50:43.907134267 +0000 UTC m=+71.747453983" watchObservedRunningTime="2026-07-21 07:50:43.908662675 +0000 UTC m=+71.748982390" Jul 21 07:51:11.825850 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:11.825813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:51:11.826259 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:11.825943 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:51:11.826259 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:11.825954 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:51:11.826259 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:11.826012 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:52:15.82599822 +0000 UTC m=+163.666317914 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:51:11.926157 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:11.926126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:51:11.926293 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:11.926251 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:51:11.926340 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:11.926310 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:52:15.92629508 +0000 UTC m=+163.766614775 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:51:13.133125 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.133071 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tc2b5" podStartSLOduration=95.139583235 podStartE2EDuration="1m40.1330416s" totalImagesPullingTime="4.993458365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:50:43.92006511 +0000 UTC m=+71.760384825" watchObservedRunningTime="2026-07-21 07:51:13.1330416 +0000 UTC m=+100.973361316" Jul 21 07:51:13.133898 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.133880 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759"] Jul 21 07:51:13.136516 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.136497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.139166 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.139146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 07:51:13.139985 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.139964 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jtt6x\"" Jul 21 07:51:13.140075 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.139991 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 07:51:13.140136 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.140082 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 07:51:13.140136 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.140083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 21 07:51:13.147490 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.147473 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759"] Jul 21 07:51:13.235125 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.235100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba37a4ed-2454-4796-8c96-d6357078990f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6578fbfcfd-b7759\" (UID: \"ba37a4ed-2454-4796-8c96-d6357078990f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.235252 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.235137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4kjj\" (UniqueName: \"kubernetes.io/projected/ba37a4ed-2454-4796-8c96-d6357078990f-kube-api-access-x4kjj\") pod \"managed-serviceaccount-addon-agent-6578fbfcfd-b7759\" (UID: \"ba37a4ed-2454-4796-8c96-d6357078990f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.335786 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.335761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba37a4ed-2454-4796-8c96-d6357078990f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6578fbfcfd-b7759\" (UID: \"ba37a4ed-2454-4796-8c96-d6357078990f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.335898 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.335800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4kjj\" (UniqueName: \"kubernetes.io/projected/ba37a4ed-2454-4796-8c96-d6357078990f-kube-api-access-x4kjj\") pod \"managed-serviceaccount-addon-agent-6578fbfcfd-b7759\" (UID: \"ba37a4ed-2454-4796-8c96-d6357078990f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.338101 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.338084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba37a4ed-2454-4796-8c96-d6357078990f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6578fbfcfd-b7759\" (UID: \"ba37a4ed-2454-4796-8c96-d6357078990f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.343965 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.343946 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4kjj\" (UniqueName: \"kubernetes.io/projected/ba37a4ed-2454-4796-8c96-d6357078990f-kube-api-access-x4kjj\") pod \"managed-serviceaccount-addon-agent-6578fbfcfd-b7759\" (UID: \"ba37a4ed-2454-4796-8c96-d6357078990f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.453902 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.453874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" Jul 21 07:51:13.576153 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.576119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759"] Jul 21 07:51:13.579515 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:51:13.579489 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba37a4ed_2454_4796_8c96_d6357078990f.slice/crio-6e67ec409fb0ddc9a24e507fb41bd206a5095352d7b2dbf46c797f090183cda3 WatchSource:0}: Error finding container 6e67ec409fb0ddc9a24e507fb41bd206a5095352d7b2dbf46c797f090183cda3: Status 404 returned error can't find the container with id 6e67ec409fb0ddc9a24e507fb41bd206a5095352d7b2dbf46c797f090183cda3 Jul 21 07:51:13.965707 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:13.965678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" event={"ID":"ba37a4ed-2454-4796-8c96-d6357078990f","Type":"ContainerStarted","Data":"6e67ec409fb0ddc9a24e507fb41bd206a5095352d7b2dbf46c797f090183cda3"} Jul 21 07:51:14.899827 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:14.899796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qgxlv" Jul 21 07:51:15.724651 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:15.724619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:51:16.975014 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:16.974984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" event={"ID":"ba37a4ed-2454-4796-8c96-d6357078990f","Type":"ContainerStarted","Data":"527c0be2d58e29a8414c99207a4ec006c433c4fae7d1a64467b3c2edde33324e"} Jul 21 07:51:17.470073 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:17.470037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:51:42.347034 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:51:42.346982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:51:42.347505 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:42.347124 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 07:51:42.347505 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:51:42.347206 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:44.347177767 +0000 UTC m=+252.187497460 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : secret "metrics-daemon-secret" not found Jul 21 07:52:10.996749 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:10.996659 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-598546d87d-5pr88" podUID="95758bf1-3f57-4f78-8c89-aaf92936fb56" Jul 21 07:52:11.035471 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:11.035445 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v8trp" podUID="1e73dfe6-a2be-483a-b9dc-86fa373709e0" Jul 21 07:52:11.104399 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:52:11.104378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:52:11.667163 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:11.667116 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:52:15.866510 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:52:15.866476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") pod \"image-registry-598546d87d-5pr88\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:52:15.866928 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:15.866588 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 07:52:15.866928 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:15.866600 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598546d87d-5pr88: secret "image-registry-tls" not found Jul 21 07:52:15.866928 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:15.866656 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls podName:95758bf1-3f57-4f78-8c89-aaf92936fb56 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:17.866642481 +0000 UTC m=+285.706962175 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls") pod "image-registry-598546d87d-5pr88" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56") : secret "image-registry-tls" not found Jul 21 07:52:15.967711 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:52:15.967683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:52:15.967851 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:15.967810 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 07:52:15.967902 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:52:15.967857 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls podName:1e73dfe6-a2be-483a-b9dc-86fa373709e0 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:17.967844607 +0000 UTC m=+285.808164305 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls") pod "dns-default-v8trp" (UID: "1e73dfe6-a2be-483a-b9dc-86fa373709e0") : secret "dns-default-metrics-tls" not found Jul 21 07:52:24.646606 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:52:24.646528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:52:24.647042 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:52:24.646529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v8trp" Jul 21 07:53:17.265833 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:17.265795 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba37a4ed-2454-4796-8c96-d6357078990f" containerID="527c0be2d58e29a8414c99207a4ec006c433c4fae7d1a64467b3c2edde33324e" exitCode=255 Jul 21 07:53:17.266210 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:17.265841 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" event={"ID":"ba37a4ed-2454-4796-8c96-d6357078990f","Type":"ContainerDied","Data":"527c0be2d58e29a8414c99207a4ec006c433c4fae7d1a64467b3c2edde33324e"} Jul 21 07:53:17.271535 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:17.271514 2578 scope.go:117] "RemoveContainer" containerID="527c0be2d58e29a8414c99207a4ec006c433c4fae7d1a64467b3c2edde33324e" Jul 21 07:53:18.269537 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:18.269504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" event={"ID":"ba37a4ed-2454-4796-8c96-d6357078990f","Type":"ContainerStarted","Data":"aabf5a3df161d8f1aa7b8c8460f43cc073f447875a0b8a65a34ded2ee1515b66"} Jul 21 07:53:18.284515 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:18.284474 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6578fbfcfd-b7759" podStartSLOduration=122.287512109 podStartE2EDuration="2m5.284460667s" totalImagesPullingTime="2.996948558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:51:16.991023933 +0000 UTC m=+104.831343649" watchObservedRunningTime="2026-07-21 07:53:18.284460667 +0000 UTC m=+226.124780382" Jul 21 07:53:44.357059 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:44.357026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:53:44.357512 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:44.357129 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 07:53:44.357512 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:44.357176 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs podName:c2c025f9-945a-43b0-904d-f7e6d763c836 nodeName:}" failed. No retries permitted until 2026-07-21 07:55:46.357162258 +0000 UTC m=+374.197481951 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs") pod "network-metrics-daemon-g8w8j" (UID: "c2c025f9-945a-43b0-904d-f7e6d763c836") : secret "metrics-daemon-secret" not found Jul 21 07:53:47.365927 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.365893 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f"] Jul 21 07:53:47.368625 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.368606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.371396 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.371376 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pf2zq"] Jul 21 07:53:47.372550 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.372531 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 07:53:47.372872 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.372858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 07:53:47.372958 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.372865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 07:53:47.373910 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.373892 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 07:53:47.373999 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.373973 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m"] Jul 21 07:53:47.374120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.374103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.374231 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.374209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-j9jxk\"" Jul 21 07:53:47.376441 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.376424 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 21 07:53:47.376950 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.376933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2wm6l\"" Jul 21 07:53:47.377052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.376969 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 07:53:47.377222 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.377202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:47.377336 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.377315 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 07:53:47.377431 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.377403 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 21 07:53:47.380699 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.380683 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 07:53:47.381049 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.381027 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 07:53:47.381600 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.381574 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 07:53:47.382092 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.382073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ps69b\"" Jul 21 07:53:47.383253 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.383230 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f"] Jul 21 07:53:47.386008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.385989 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 21 07:53:47.386701 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.386682 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m"] Jul 21 07:53:47.389129 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.389110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pf2zq"] Jul 21 07:53:47.458010 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.457980 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d"] Jul 21 07:53:47.460721 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.460706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.463019 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.462998 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 07:53:47.463130 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.463077 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 07:53:47.463284 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.463269 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 07:53:47.463370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.463291 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 07:53:47.463370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.463363 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9s4cg\"" Jul 21 07:53:47.468973 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.468955 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d"] Jul 21 07:53:47.476792 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.476772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.476886 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.476817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvld\" (UniqueName: \"kubernetes.io/projected/ee3355fe-5f12-4366-8650-55cb0e1d5008-kube-api-access-ztvld\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.476886 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.476846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3355fe-5f12-4366-8650-55cb0e1d5008-serving-cert\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.477052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.476905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6e0291d1-fad3-4e7b-b57d-847ae6f75064-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.477052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.476968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3355fe-5f12-4366-8650-55cb0e1d5008-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.477052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.476996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3355fe-5f12-4366-8650-55cb0e1d5008-service-ca-bundle\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.477052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.477019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksn7s\" (UniqueName: \"kubernetes.io/projected/6e0291d1-fad3-4e7b-b57d-847ae6f75064-kube-api-access-ksn7s\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.477052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.477048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee3355fe-5f12-4366-8650-55cb0e1d5008-tmp\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.477240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.477083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ee3355fe-5f12-4366-8650-55cb0e1d5008-snapshots\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.477240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.477131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:47.477240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.477161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvdtv\" (UniqueName: \"kubernetes.io/projected/683fa5c6-2442-4ccb-8750-e303bc6ffb68-kube-api-access-pvdtv\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:47.578171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvdtv\" (UniqueName: \"kubernetes.io/projected/683fa5c6-2442-4ccb-8750-e303bc6ffb68-kube-api-access-pvdtv\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:47.578370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.578370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeff430-4375-4a33-9c98-ef22ef041223-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.578370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvld\" (UniqueName: \"kubernetes.io/projected/ee3355fe-5f12-4366-8650-55cb0e1d5008-kube-api-access-ztvld\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.578370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3355fe-5f12-4366-8650-55cb0e1d5008-serving-cert\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.578370 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:47.578338 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:47.578370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6e0291d1-fad3-4e7b-b57d-847ae6f75064-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:47.578403 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls podName:6e0291d1-fad3-4e7b-b57d-847ae6f75064 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:48.078387444 +0000 UTC m=+255.918707140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tc54f" (UID: "6e0291d1-fad3-4e7b-b57d-847ae6f75064") : secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3355fe-5f12-4366-8650-55cb0e1d5008-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aeff430-4375-4a33-9c98-ef22ef041223-config\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3355fe-5f12-4366-8650-55cb0e1d5008-service-ca-bundle\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksn7s\" (UniqueName: \"kubernetes.io/projected/6e0291d1-fad3-4e7b-b57d-847ae6f75064-kube-api-access-ksn7s\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578565 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee3355fe-5f12-4366-8650-55cb0e1d5008-tmp\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ee3355fe-5f12-4366-8650-55cb0e1d5008-snapshots\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf94d\" (UniqueName: \"kubernetes.io/projected/0aeff430-4375-4a33-9c98-ef22ef041223-kube-api-access-lf94d\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.578681 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.578643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:47.579449 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.579424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee3355fe-5f12-4366-8650-55cb0e1d5008-tmp\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.579531 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.579457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3355fe-5f12-4366-8650-55cb0e1d5008-service-ca-bundle\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.579531 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.579474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6e0291d1-fad3-4e7b-b57d-847ae6f75064-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.579531 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:47.579497 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 07:53:47.579671 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.579550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ee3355fe-5f12-4366-8650-55cb0e1d5008-snapshots\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.579671 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:47.579565 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls podName:683fa5c6-2442-4ccb-8750-e303bc6ffb68 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:48.079539379 +0000 UTC m=+255.919859074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-n2d2m" (UID: "683fa5c6-2442-4ccb-8750-e303bc6ffb68") : secret "samples-operator-tls" not found Jul 21 07:53:47.580029 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.580007 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3355fe-5f12-4366-8650-55cb0e1d5008-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.585195 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.585172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3355fe-5f12-4366-8650-55cb0e1d5008-serving-cert\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.587032 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.587010 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvdtv\" (UniqueName: \"kubernetes.io/projected/683fa5c6-2442-4ccb-8750-e303bc6ffb68-kube-api-access-pvdtv\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:47.587361 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.587343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksn7s\" (UniqueName: \"kubernetes.io/projected/6e0291d1-fad3-4e7b-b57d-847ae6f75064-kube-api-access-ksn7s\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:47.587430 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.587408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvld\" (UniqueName: \"kubernetes.io/projected/ee3355fe-5f12-4366-8650-55cb0e1d5008-kube-api-access-ztvld\") pod \"insights-operator-555d9d7885-pf2zq\" (UID: \"ee3355fe-5f12-4366-8650-55cb0e1d5008\") " pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.605770 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.605723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:47.657864 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.657833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:47.679003 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.678981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aeff430-4375-4a33-9c98-ef22ef041223-config\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.679080 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.679012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf94d\" (UniqueName: \"kubernetes.io/projected/0aeff430-4375-4a33-9c98-ef22ef041223-kube-api-access-lf94d\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.679080 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.679056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeff430-4375-4a33-9c98-ef22ef041223-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.679492 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.679471 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aeff430-4375-4a33-9c98-ef22ef041223-config\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.681142 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.681127 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeff430-4375-4a33-9c98-ef22ef041223-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.686995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.686975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf94d\" (UniqueName: \"kubernetes.io/projected/0aeff430-4375-4a33-9c98-ef22ef041223-kube-api-access-lf94d\") pod \"service-ca-operator-5bcbc94c78-jnh8d\" (UID: \"0aeff430-4375-4a33-9c98-ef22ef041223\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.688861 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.688842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" Jul 21 07:53:47.769006 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.768980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" Jul 21 07:53:47.829970 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.829946 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pf2zq"] Jul 21 07:53:47.833127 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:53:47.833100 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3355fe_5f12_4366_8650_55cb0e1d5008.slice/crio-15b12009d1ca93b1c94262778de35c737a3ade75fd8a66edab70a834cfb45b57 WatchSource:0}: Error finding container 15b12009d1ca93b1c94262778de35c737a3ade75fd8a66edab70a834cfb45b57: Status 404 returned error can't find the container with id 15b12009d1ca93b1c94262778de35c737a3ade75fd8a66edab70a834cfb45b57 Jul 21 07:53:47.886244 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:47.886218 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d"] Jul 21 07:53:47.888837 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:53:47.888810 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeff430_4375_4a33_9c98_ef22ef041223.slice/crio-eccf8cb487da983543953933e95eeb66dc588066174016e246969331721c204c WatchSource:0}: Error finding container eccf8cb487da983543953933e95eeb66dc588066174016e246969331721c204c: Status 404 returned error can't find the container with id eccf8cb487da983543953933e95eeb66dc588066174016e246969331721c204c Jul 21 07:53:48.082687 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:48.082620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:48.082815 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:48.082698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:48.082815 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:48.082784 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:48.082815 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:48.082814 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 07:53:48.082928 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:48.082856 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls podName:683fa5c6-2442-4ccb-8750-e303bc6ffb68 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:49.082842575 +0000 UTC m=+256.923162269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-n2d2m" (UID: "683fa5c6-2442-4ccb-8750-e303bc6ffb68") : secret "samples-operator-tls" not found Jul 21 07:53:48.082928 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:48.082868 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls podName:6e0291d1-fad3-4e7b-b57d-847ae6f75064 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:49.082862643 +0000 UTC m=+256.923182338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tc54f" (UID: "6e0291d1-fad3-4e7b-b57d-847ae6f75064") : secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:48.344022 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:48.343939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" event={"ID":"0aeff430-4375-4a33-9c98-ef22ef041223","Type":"ContainerStarted","Data":"eccf8cb487da983543953933e95eeb66dc588066174016e246969331721c204c"} Jul 21 07:53:48.345106 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:48.345079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" event={"ID":"ee3355fe-5f12-4366-8650-55cb0e1d5008","Type":"ContainerStarted","Data":"15b12009d1ca93b1c94262778de35c737a3ade75fd8a66edab70a834cfb45b57"} Jul 21 07:53:49.090438 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:49.090396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:49.090874 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:49.090456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:49.090874 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:49.090574 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 07:53:49.090874 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:49.090586 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:49.090874 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:49.090648 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls podName:683fa5c6-2442-4ccb-8750-e303bc6ffb68 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:51.09062579 +0000 UTC m=+258.930945493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-n2d2m" (UID: "683fa5c6-2442-4ccb-8750-e303bc6ffb68") : secret "samples-operator-tls" not found Jul 21 07:53:49.090874 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:49.090671 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls podName:6e0291d1-fad3-4e7b-b57d-847ae6f75064 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:51.090660553 +0000 UTC m=+258.930980260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tc54f" (UID: "6e0291d1-fad3-4e7b-b57d-847ae6f75064") : secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:49.479433 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:49.479392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:49.530501 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:49.530458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:50.352344 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:50.352306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" event={"ID":"0aeff430-4375-4a33-9c98-ef22ef041223","Type":"ContainerStarted","Data":"2f1bd8d77d31ba0c53aed1a0ff3f03df41fb47107bd0a9090dc7e0833e22477f"} Jul 21 07:53:50.353940 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:50.353912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" event={"ID":"ee3355fe-5f12-4366-8650-55cb0e1d5008","Type":"ContainerStarted","Data":"19b7097da5f1ae8614e8c262dcd2ebec7396735116ce09ca5a4ab46cb8e6d1b6"} Jul 21 07:53:50.367209 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:50.367151 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" podStartSLOduration=1.026882574 podStartE2EDuration="3.367134469s" totalImagesPullingTime="2.340251895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:53:50.366690086 +0000 UTC m=+258.207009801" watchObservedRunningTime="2026-07-21 07:53:50.367134469 +0000 UTC m=+258.207454186" Jul 21 07:53:50.382171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:50.382120 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" podStartSLOduration=0.990041923 podStartE2EDuration="3.382105216s" totalImagesPullingTime="2.392063293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:53:50.381146794 +0000 UTC m=+258.221466511" watchObservedRunningTime="2026-07-21 07:53:50.382105216 +0000 UTC m=+258.222424931" Jul 21 07:53:51.111159 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.111124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:51.111336 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.111242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:51.111336 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.111291 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:51.111452 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.111346 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 07:53:51.111452 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.111363 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls podName:6e0291d1-fad3-4e7b-b57d-847ae6f75064 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:55.111342469 +0000 UTC m=+262.951662178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tc54f" (UID: "6e0291d1-fad3-4e7b-b57d-847ae6f75064") : secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:51.111452 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.111390 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls podName:683fa5c6-2442-4ccb-8750-e303bc6ffb68 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:55.11137991 +0000 UTC m=+262.951699606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-n2d2m" (UID: "683fa5c6-2442-4ccb-8750-e303bc6ffb68") : secret "samples-operator-tls" not found Jul 21 07:53:51.161535 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.161494 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p7j7s"] Jul 21 07:53:51.164791 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.164771 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.166952 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.166926 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 07:53:51.167078 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.167005 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 07:53:51.167078 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.167065 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9m7pp\"" Jul 21 07:53:51.175578 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.175554 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p7j7s"] Jul 21 07:53:51.185442 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.185412 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:51.238018 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.237983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:51.313493 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.313447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ce0bb16-7b82-4b34-a322-16fbb2229333-crio-socket\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.313493 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.313495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.313753 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.313586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce0bb16-7b82-4b34-a322-16fbb2229333-data-volume\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.313753 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.313613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.313753 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.313658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p529\" (UniqueName: \"kubernetes.io/projected/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-api-access-6p529\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414260 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ce0bb16-7b82-4b34-a322-16fbb2229333-crio-socket\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ce0bb16-7b82-4b34-a322-16fbb2229333-crio-socket\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce0bb16-7b82-4b34-a322-16fbb2229333-data-volume\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.414364 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.414426 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:51.91441096 +0000 UTC m=+259.754730658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : configmap "kube-rbac-proxy" not found Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p529\" (UniqueName: \"kubernetes.io/projected/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-api-access-6p529\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.414499 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 07:53:51.414662 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.414563 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:51.914547183 +0000 UTC m=+259.754866890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : secret "insights-runtime-extractor-tls" not found Jul 21 07:53:51.414969 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.414673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce0bb16-7b82-4b34-a322-16fbb2229333-data-volume\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.424825 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.424794 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p529\" (UniqueName: \"kubernetes.io/projected/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-api-access-6p529\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.919077 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.919040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.919244 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.919119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:51.919244 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.919165 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 07:53:51.919244 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.919230 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:52.919215431 +0000 UTC m=+260.759535128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : configmap "kube-rbac-proxy" not found Jul 21 07:53:51.919359 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.919261 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 07:53:51.919359 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:51.919331 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:52.919318093 +0000 UTC m=+260.759637790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : secret "insights-runtime-extractor-tls" not found Jul 21 07:53:51.970055 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:51.970018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:52.025028 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.024997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:52.303408 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.303284 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:52.355520 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.355448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:52.677891 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.677858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:52.779423 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.779390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:52.928510 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.928427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:52.928669 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:52.928512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:52.928669 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:52.928553 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 07:53:52.928669 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:52.928578 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 07:53:52.928669 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:52.928622 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:54.928609122 +0000 UTC m=+262.768928816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : configmap "kube-rbac-proxy" not found Jul 21 07:53:52.928669 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:52.928634 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:54.928627868 +0000 UTC m=+262.768947562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : secret "insights-runtime-extractor-tls" not found Jul 21 07:53:53.135117 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:53.135090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kth4k_619f7e1b-dc9c-4c67-8171-89c8d818fbe5/dns-node-resolver/0.log" Jul 21 07:53:53.185669 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:53.185579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:53.240164 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:53.240125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:54.296956 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.296918 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mtb7n"] Jul 21 07:53:54.300045 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.300023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.302482 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.302457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mqjjg\"" Jul 21 07:53:54.302602 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.302459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 21 07:53:54.302602 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.302485 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 21 07:53:54.303317 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.303301 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 21 07:53:54.303412 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.303356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 21 07:53:54.307790 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.307769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mtb7n"] Jul 21 07:53:54.334389 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.334371 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4p79_b688a809-9200-4960-8e1d-946f12916d5a/node-ca/0.log" Jul 21 07:53:54.438926 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.438855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5913c42-9ac2-406e-80bf-71627e55dd61-signing-cabundle\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.438926 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.438885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5913c42-9ac2-406e-80bf-71627e55dd61-signing-key\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.439094 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.438944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pnbp\" (UniqueName: \"kubernetes.io/projected/c5913c42-9ac2-406e-80bf-71627e55dd61-kube-api-access-5pnbp\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.483518 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.483491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:54.536678 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.536650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:54.539506 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.539479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5913c42-9ac2-406e-80bf-71627e55dd61-signing-cabundle\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.539601 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.539513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5913c42-9ac2-406e-80bf-71627e55dd61-signing-key\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.539601 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.539577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pnbp\" (UniqueName: \"kubernetes.io/projected/c5913c42-9ac2-406e-80bf-71627e55dd61-kube-api-access-5pnbp\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.540193 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.540177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5913c42-9ac2-406e-80bf-71627e55dd61-signing-cabundle\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.541927 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.541908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5913c42-9ac2-406e-80bf-71627e55dd61-signing-key\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.546618 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.546596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pnbp\" (UniqueName: \"kubernetes.io/projected/c5913c42-9ac2-406e-80bf-71627e55dd61-kube-api-access-5pnbp\") pod \"service-ca-58598695f7-mtb7n\" (UID: \"c5913c42-9ac2-406e-80bf-71627e55dd61\") " pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.608970 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.608910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mtb7n" Jul 21 07:53:54.730014 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.729989 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mtb7n"] Jul 21 07:53:54.731169 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:53:54.731139 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5913c42_9ac2_406e_80bf_71627e55dd61.slice/crio-2bcfc2a0e0b7d21bf1f711416116b2a315259e170ce340305daa74d37d236763 WatchSource:0}: Error finding container 2bcfc2a0e0b7d21bf1f711416116b2a315259e170ce340305daa74d37d236763: Status 404 returned error can't find the container with id 2bcfc2a0e0b7d21bf1f711416116b2a315259e170ce340305daa74d37d236763 Jul 21 07:53:54.943280 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.943253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:54.943447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:54.943312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:54.943447 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:54.943377 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 07:53:54.943447 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:54.943403 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 07:53:54.943447 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:54.943444 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:58.943424212 +0000 UTC m=+266.783743908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : configmap "kube-rbac-proxy" not found Jul 21 07:53:54.943622 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:54.943463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:53:58.943454243 +0000 UTC m=+266.783773938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : secret "insights-runtime-extractor-tls" not found Jul 21 07:53:55.135503 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.135478 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vvbpl_88edd8f7-ade8-4af6-b44f-5ec67f59e4c4/serve-healthcheck-canary/0.log" Jul 21 07:53:55.144770 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.144721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:53:55.144885 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.144803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:53:55.144885 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:55.144825 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 07:53:55.144885 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:55.144883 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls podName:683fa5c6-2442-4ccb-8750-e303bc6ffb68 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:03.144865799 +0000 UTC m=+270.985185496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-n2d2m" (UID: "683fa5c6-2442-4ccb-8750-e303bc6ffb68") : secret "samples-operator-tls" not found Jul 21 07:53:55.145024 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:55.144920 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:55.145024 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:55.144967 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls podName:6e0291d1-fad3-4e7b-b57d-847ae6f75064 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:03.144951098 +0000 UTC m=+270.985270800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tc54f" (UID: "6e0291d1-fad3-4e7b-b57d-847ae6f75064") : secret "cluster-monitoring-operator-tls" not found Jul 21 07:53:55.365773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.365676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:55.375224 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.375201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mtb7n" event={"ID":"c5913c42-9ac2-406e-80bf-71627e55dd61","Type":"ContainerStarted","Data":"d780e0d5a1b21bf2d57a21fe391ff92b91cf4346606dc19d2b05b79385049492"} Jul 21 07:53:55.375306 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.375241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mtb7n" event={"ID":"c5913c42-9ac2-406e-80bf-71627e55dd61","Type":"ContainerStarted","Data":"2bcfc2a0e0b7d21bf1f711416116b2a315259e170ce340305daa74d37d236763"} Jul 21 07:53:55.392081 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:55.392037 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-mtb7n" podStartSLOduration=1.392024559 podStartE2EDuration="1.392024559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:53:55.391584808 +0000 UTC m=+263.231904549" watchObservedRunningTime="2026-07-21 07:53:55.392024559 +0000 UTC m=+263.232344274" Jul 21 07:53:56.213278 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:56.213238 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:56.366710 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:56.366673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:56.470018 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:56.469934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:56.592763 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:56.592716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:56.933631 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:56.933598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:57.541889 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:57.541857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:57.898760 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:57.898713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:58.352333 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:58.352297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:58.494132 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:58.494099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:58.895152 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:58.895119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:58.977019 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:58.976979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:58.977199 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:58.977067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:53:58.977199 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:58.977110 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 07:53:58.977199 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:58.977189 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:06.977167985 +0000 UTC m=+274.817487682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : configmap "kube-rbac-proxy" not found Jul 21 07:53:58.977327 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:58.977206 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 07:53:58.977327 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:53:58.977258 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls podName:7ce0bb16-7b82-4b34-a322-16fbb2229333 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:06.977244789 +0000 UTC m=+274.817564483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7j7s" (UID: "7ce0bb16-7b82-4b34-a322-16fbb2229333") : secret "insights-runtime-extractor-tls" not found Jul 21 07:53:59.096925 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:59.096886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:59.500145 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:59.500112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:59.906708 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:59.906638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:53:59.972879 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:53:59.972855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:00.095862 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:00.095839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:00.699990 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:00.699954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:00.894808 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:00.894776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:01.297501 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:01.297468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:01.583920 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:01.583831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:02.091441 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:02.091411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:02.490547 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:02.490517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:02.706165 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:02.706136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:02.894060 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:02.893983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:03.093358 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.093329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:03.211013 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.210980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:54:03.211174 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.211021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:54:03.211174 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:03.211120 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 07:54:03.211249 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:03.211184 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls podName:6e0291d1-fad3-4e7b-b57d-847ae6f75064 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:19.211169624 +0000 UTC m=+287.051489321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tc54f" (UID: "6e0291d1-fad3-4e7b-b57d-847ae6f75064") : secret "cluster-monitoring-operator-tls" not found Jul 21 07:54:03.213292 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.213264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/683fa5c6-2442-4ccb-8750-e303bc6ffb68-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-n2d2m\" (UID: \"683fa5c6-2442-4ccb-8750-e303bc6ffb68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:54:03.294447 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.294412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" Jul 21 07:54:03.295435 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.295411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:03.419568 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:03.419545 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m"] Jul 21 07:54:04.347451 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:04.347411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:04.401847 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:04.401807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" event={"ID":"683fa5c6-2442-4ccb-8750-e303bc6ffb68","Type":"ContainerStarted","Data":"dee12577e02fc7d101b99bc71c0d367a076e640938807f4945802f702b25115c"} Jul 21 07:54:04.448437 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:04.448393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:04.548883 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:04.548818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:04.893534 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:04.893491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:05.089448 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:05.089407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:05.292269 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:05.292238 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:05.406523 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:05.406492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" event={"ID":"683fa5c6-2442-4ccb-8750-e303bc6ffb68","Type":"ContainerStarted","Data":"44625e8351858e23d31ce8903d3e32bd848834a7ecb74819a1a2ab39184d1564"} Jul 21 07:54:05.406912 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:05.406541 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" event={"ID":"683fa5c6-2442-4ccb-8750-e303bc6ffb68","Type":"ContainerStarted","Data":"bdb32f6f147a84e0ae05f1a4fd2fdc2f2dfb10f9a0a7e4d7459ef95a3bf7f5e3"} Jul 21 07:54:05.425476 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:05.425433 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-n2d2m" podStartSLOduration=16.914063967 podStartE2EDuration="18.425417707s" totalImagesPullingTime="1.51135374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:05.424404952 +0000 UTC m=+273.264724668" watchObservedRunningTime="2026-07-21 07:54:05.425417707 +0000 UTC m=+273.265737442" Jul 21 07:54:05.958286 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:05.958252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:06.016187 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:06.016135 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:06.066446 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:06.066403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:06.120274 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:06.120230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:06.495871 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:06.495790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:06.692538 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:06.692503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:06.909021 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:06.907128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:07.038921 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.038885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:54:07.039086 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.038946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:54:07.039525 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.039500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ce0bb16-7b82-4b34-a322-16fbb2229333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:54:07.041229 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.041211 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ce0bb16-7b82-4b34-a322-16fbb2229333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7j7s\" (UID: \"7ce0bb16-7b82-4b34-a322-16fbb2229333\") " pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:54:07.075962 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.075936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p7j7s" Jul 21 07:54:07.204378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.204301 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p7j7s"] Jul 21 07:54:07.208229 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:07.208190 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce0bb16_7b82_4b34_a322_16fbb2229333.slice/crio-e1af3e9d202c0100a6ba38afd2b1cf79e58ab369a18f1cb5ff10c7230a9daaff WatchSource:0}: Error finding container e1af3e9d202c0100a6ba38afd2b1cf79e58ab369a18f1cb5ff10c7230a9daaff: Status 404 returned error can't find the container with id e1af3e9d202c0100a6ba38afd2b1cf79e58ab369a18f1cb5ff10c7230a9daaff Jul 21 07:54:07.413818 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:07.413782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7j7s" event={"ID":"7ce0bb16-7b82-4b34-a322-16fbb2229333","Type":"ContainerStarted","Data":"e1af3e9d202c0100a6ba38afd2b1cf79e58ab369a18f1cb5ff10c7230a9daaff"} Jul 21 07:54:12.433680 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:12.433625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7j7s" event={"ID":"7ce0bb16-7b82-4b34-a322-16fbb2229333","Type":"ContainerStarted","Data":"1b8a788c36731b28e980de7de8a89b273e78f3113c5b29ee762fd4f38450ce33"} Jul 21 07:54:12.752923 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:12.752837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:12.855052 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:12.855010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:12.954263 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:12.954185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:13.054588 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:13.054503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:13.450038 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:13.450007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:13.549884 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:13.549847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:13.663616 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:13.663573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:13.734685 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:13.734600 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:14.105012 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:14.104928 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-598546d87d-5pr88" podUID="95758bf1-3f57-4f78-8c89-aaf92936fb56" Jul 21 07:54:14.440202 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:14.440171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:54:14.635548 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:14.635519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:14.835621 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:14.835543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:15.091241 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:15.091162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:15.445190 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:15.445157 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7j7s" event={"ID":"7ce0bb16-7b82-4b34-a322-16fbb2229333","Type":"ContainerStarted","Data":"1f922f3623c34806a72fd857edd46c50b6d83f6967d3defad5973cc40551a295"} Jul 21 07:54:15.656884 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:15.656801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:15.716092 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:15.716065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:16.294621 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.294571 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-598546d87d-5pr88"] Jul 21 07:54:16.294898 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:16.294868 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-598546d87d-5pr88" podUID="95758bf1-3f57-4f78-8c89-aaf92936fb56" Jul 21 07:54:16.340488 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.340453 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fd44879bd-2m9tj"] Jul 21 07:54:16.343668 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.343646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.348134 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.348103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:16.355468 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.355402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd44879bd-2m9tj"] Jul 21 07:54:16.415113 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90db4979-9a91-42ea-98ea-ec72f9f23af4-registry-certificates\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415282 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-registry-tls\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415282 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-bound-sa-token\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415282 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90db4979-9a91-42ea-98ea-ec72f9f23af4-image-registry-private-configuration\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415282 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90db4979-9a91-42ea-98ea-ec72f9f23af4-installation-pull-secrets\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415495 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90db4979-9a91-42ea-98ea-ec72f9f23af4-ca-trust-extracted\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415495 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90db4979-9a91-42ea-98ea-ec72f9f23af4-trusted-ca\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.415495 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.415361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9sn\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-kube-api-access-7d9sn\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.437612 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.437570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:16.448573 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.448504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:54:16.455745 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.455693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:54:16.516633 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516597 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-trusted-ca\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.516842 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516687 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-installation-pull-secrets\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.516842 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516740 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh8bg\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-kube-api-access-kh8bg\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.516842 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516770 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-bound-sa-token\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.516842 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516803 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-image-registry-private-configuration\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.516842 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516832 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-certificates\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516863 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95758bf1-3f57-4f78-8c89-aaf92936fb56-ca-trust-extracted\") pod \"95758bf1-3f57-4f78-8c89-aaf92936fb56\" (UID: \"95758bf1-3f57-4f78-8c89-aaf92936fb56\") " Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90db4979-9a91-42ea-98ea-ec72f9f23af4-registry-certificates\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.516998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-registry-tls\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-bound-sa-token\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90db4979-9a91-42ea-98ea-ec72f9f23af4-image-registry-private-configuration\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90db4979-9a91-42ea-98ea-ec72f9f23af4-installation-pull-secrets\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90db4979-9a91-42ea-98ea-ec72f9f23af4-ca-trust-extracted\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517464 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90db4979-9a91-42ea-98ea-ec72f9f23af4-trusted-ca\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517464 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9sn\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-kube-api-access-7d9sn\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.517464 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517212 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:54:16.517464 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517368 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-trusted-ca\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.517464 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517369 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95758bf1-3f57-4f78-8c89-aaf92936fb56-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:54:16.517714 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.517541 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:54:16.519188 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.518102 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90db4979-9a91-42ea-98ea-ec72f9f23af4-ca-trust-extracted\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.519188 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.518264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90db4979-9a91-42ea-98ea-ec72f9f23af4-registry-certificates\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.519188 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.519137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90db4979-9a91-42ea-98ea-ec72f9f23af4-trusted-ca\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.520362 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.520334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90db4979-9a91-42ea-98ea-ec72f9f23af4-installation-pull-secrets\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.520568 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.520495 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:54:16.520688 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.520621 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:54:16.521397 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.521371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90db4979-9a91-42ea-98ea-ec72f9f23af4-image-registry-private-configuration\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.521804 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.521783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-registry-tls\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.521923 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.521903 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-kube-api-access-kh8bg" (OuterVolumeSpecName: "kube-api-access-kh8bg") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "kube-api-access-kh8bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:54:16.522212 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.522188 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "95758bf1-3f57-4f78-8c89-aaf92936fb56" (UID: "95758bf1-3f57-4f78-8c89-aaf92936fb56"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:54:16.529264 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.529238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9sn\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-kube-api-access-7d9sn\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.529648 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.529607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90db4979-9a91-42ea-98ea-ec72f9f23af4-bound-sa-token\") pod \"image-registry-5fd44879bd-2m9tj\" (UID: \"90db4979-9a91-42ea-98ea-ec72f9f23af4\") " pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.618680 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.618588 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-installation-pull-secrets\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.618680 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.618631 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh8bg\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-kube-api-access-kh8bg\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.618680 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.618646 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-bound-sa-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.618680 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.618663 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95758bf1-3f57-4f78-8c89-aaf92936fb56-image-registry-private-configuration\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.618680 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.618678 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-certificates\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.618990 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.618691 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95758bf1-3f57-4f78-8c89-aaf92936fb56-ca-trust-extracted\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:16.656907 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.656875 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gl75q\"" Jul 21 07:54:16.665317 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.665292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:16.820302 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:16.820262 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd44879bd-2m9tj"] Jul 21 07:54:16.823981 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:16.823946 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90db4979_9a91_42ea_98ea_ec72f9f23af4.slice/crio-8ae3c7c9beed568661b8181edfa9bd11a57d584c054ca8ce2ba07bcac9221c49 WatchSource:0}: Error finding container 8ae3c7c9beed568661b8181edfa9bd11a57d584c054ca8ce2ba07bcac9221c49: Status 404 returned error can't find the container with id 8ae3c7c9beed568661b8181edfa9bd11a57d584c054ca8ce2ba07bcac9221c49 Jul 21 07:54:17.458189 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.458133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" event={"ID":"90db4979-9a91-42ea-98ea-ec72f9f23af4","Type":"ContainerStarted","Data":"9cbbe993fa12bf91188c0e8562cce84d3382dbcf3562c80fa9b11669d78e18ee"} Jul 21 07:54:17.458411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.458157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598546d87d-5pr88" Jul 21 07:54:17.458411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.458238 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" event={"ID":"90db4979-9a91-42ea-98ea-ec72f9f23af4","Type":"ContainerStarted","Data":"8ae3c7c9beed568661b8181edfa9bd11a57d584c054ca8ce2ba07bcac9221c49"} Jul 21 07:54:17.458411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.458382 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:17.480887 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.480822 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" podStartSLOduration=1.480800649 podStartE2EDuration="1.480800649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:17.479839759 +0000 UTC m=+285.320159474" watchObservedRunningTime="2026-07-21 07:54:17.480800649 +0000 UTC m=+285.321120367" Jul 21 07:54:17.509347 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.509316 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-598546d87d-5pr88"] Jul 21 07:54:17.513753 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.513715 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-598546d87d-5pr88"] Jul 21 07:54:17.627562 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:17.627526 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95758bf1-3f57-4f78-8c89-aaf92936fb56-registry-tls\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:54:18.030603 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:18.030561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:54:18.033031 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:18.033003 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e73dfe6-a2be-483a-b9dc-86fa373709e0-metrics-tls\") pod \"dns-default-v8trp\" (UID: \"1e73dfe6-a2be-483a-b9dc-86fa373709e0\") " pod="openshift-dns/dns-default-v8trp" Jul 21 07:54:18.049475 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:18.049454 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wt7l9\"" Jul 21 07:54:18.057773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:18.057752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v8trp" Jul 21 07:54:18.651628 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:18.651587 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95758bf1-3f57-4f78-8c89-aaf92936fb56" path="/var/lib/kubelet/pods/95758bf1-3f57-4f78-8c89-aaf92936fb56/volumes" Jul 21 07:54:19.003707 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.003683 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v8trp"] Jul 21 07:54:19.006001 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:19.005977 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e73dfe6_a2be_483a_b9dc_86fa373709e0.slice/crio-6c90d5b5d7ac34b9a6b936517485d268b3357707272598e8d622cbf32450a22d WatchSource:0}: Error finding container 6c90d5b5d7ac34b9a6b936517485d268b3357707272598e8d622cbf32450a22d: Status 404 returned error can't find the container with id 6c90d5b5d7ac34b9a6b936517485d268b3357707272598e8d622cbf32450a22d Jul 21 07:54:19.241474 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.241379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:54:19.243771 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.243750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e0291d1-fad3-4e7b-b57d-847ae6f75064-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tc54f\" (UID: \"6e0291d1-fad3-4e7b-b57d-847ae6f75064\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:54:19.468075 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.467873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7j7s" event={"ID":"7ce0bb16-7b82-4b34-a322-16fbb2229333","Type":"ContainerStarted","Data":"3a4a2128fb8420469a64b107059a311862a61724d88a7392fdac6bf597262b7c"} Jul 21 07:54:19.469098 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.469067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v8trp" event={"ID":"1e73dfe6-a2be-483a-b9dc-86fa373709e0","Type":"ContainerStarted","Data":"6c90d5b5d7ac34b9a6b936517485d268b3357707272598e8d622cbf32450a22d"} Jul 21 07:54:19.479395 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.479362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" Jul 21 07:54:19.484642 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.484592 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p7j7s" podStartSLOduration=16.879905485 podStartE2EDuration="28.484573771s" totalImagesPullingTime="11.604668286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:53:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:19.483525984 +0000 UTC m=+287.323845701" watchObservedRunningTime="2026-07-21 07:54:19.484573771 +0000 UTC m=+287.324893487" Jul 21 07:54:19.650463 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:19.650422 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f"] Jul 21 07:54:19.653553 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:19.653524 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0291d1_fad3_4e7b_b57d_847ae6f75064.slice/crio-c009e4f895e13d175bc2a08e3c904c36668c453bbc91b2877bf006f1749835d5 WatchSource:0}: Error finding container c009e4f895e13d175bc2a08e3c904c36668c453bbc91b2877bf006f1749835d5: Status 404 returned error can't find the container with id c009e4f895e13d175bc2a08e3c904c36668c453bbc91b2877bf006f1749835d5 Jul 21 07:54:20.474223 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:20.474183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" event={"ID":"6e0291d1-fad3-4e7b-b57d-847ae6f75064","Type":"ContainerStarted","Data":"c009e4f895e13d175bc2a08e3c904c36668c453bbc91b2877bf006f1749835d5"} Jul 21 07:54:21.480157 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:21.480123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v8trp" event={"ID":"1e73dfe6-a2be-483a-b9dc-86fa373709e0","Type":"ContainerStarted","Data":"0ac558d548bc5f12cbb404c57664e27b198856a44730df48d421e35dff8002ad"} Jul 21 07:54:21.480699 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:21.480181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v8trp" event={"ID":"1e73dfe6-a2be-483a-b9dc-86fa373709e0","Type":"ContainerStarted","Data":"f21ff18b47ff9b5c94f45923b4a02e0f96bf6a7730848583546b9da46a61bdd5"} Jul 21 07:54:21.480699 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:21.480228 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v8trp" Jul 21 07:54:21.496254 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:21.496197 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v8trp" podStartSLOduration=252.89821316 podStartE2EDuration="4m14.496179723s" totalImagesPullingTime="1.597966563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:21.495693138 +0000 UTC m=+289.336012866" watchObservedRunningTime="2026-07-21 07:54:21.496179723 +0000 UTC m=+289.336499440" Jul 21 07:54:22.187562 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.187532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:22.327455 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.327426 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99"] Jul 21 07:54:22.331806 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.331786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:22.334017 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.334001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 07:54:22.334091 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.334072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jcwb8\"" Jul 21 07:54:22.339187 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.339162 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99"] Jul 21 07:54:22.368295 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.368269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/92c9dbdd-564b-4a82-b0f7-83c095996e80-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2nk99\" (UID: \"92c9dbdd-564b-4a82-b0f7-83c095996e80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:22.468987 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.468906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/92c9dbdd-564b-4a82-b0f7-83c095996e80-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2nk99\" (UID: \"92c9dbdd-564b-4a82-b0f7-83c095996e80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:22.469148 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:22.469084 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 21 07:54:22.469218 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:22.469179 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9dbdd-564b-4a82-b0f7-83c095996e80-tls-certificates podName:92c9dbdd-564b-4a82-b0f7-83c095996e80 nodeName:}" failed. No retries permitted until 2026-07-21 07:54:22.969149792 +0000 UTC m=+290.809469492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/92c9dbdd-564b-4a82-b0f7-83c095996e80-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-2nk99" (UID: "92c9dbdd-564b-4a82-b0f7-83c095996e80") : secret "prometheus-operator-admission-webhook-tls" not found Jul 21 07:54:22.485308 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.485278 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" event={"ID":"6e0291d1-fad3-4e7b-b57d-847ae6f75064","Type":"ContainerStarted","Data":"704631c937d98f42ae7f5325b40bd6a1609e159c3464e519f03c467a0d45455e"} Jul 21 07:54:22.500917 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.500865 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tc54f" podStartSLOduration=33.310768249 podStartE2EDuration="35.500846357s" totalImagesPullingTime="2.190078108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:22.499369975 +0000 UTC m=+290.339689685" watchObservedRunningTime="2026-07-21 07:54:22.500846357 +0000 UTC m=+290.341166074" Jul 21 07:54:22.671350 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.671321 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dff98cf55-z569j"] Jul 21 07:54:22.674402 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.674385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.677046 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677022 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 07:54:22.677157 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 07:54:22.677157 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677124 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 07:54:22.677270 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677233 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 07:54:22.677435 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 07:54:22.677494 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677474 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 07:54:22.677919 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677906 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 07:54:22.678007 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.677921 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kjhvq\"" Jul 21 07:54:22.682986 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.682966 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dff98cf55-z569j"] Jul 21 07:54:22.770995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.770935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-oauth-config\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.770995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.770965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-service-ca\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.771124 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.771012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-console-config\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.771124 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.771076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-serving-cert\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.771124 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.771113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-oauth-serving-cert\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.771212 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.771129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfflb\" (UniqueName: \"kubernetes.io/projected/0bd443bc-e364-4355-976d-c839aa094663-kube-api-access-cfflb\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.872247 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.872217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-serving-cert\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.872247 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.872250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-oauth-serving-cert\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.872423 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.872267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfflb\" (UniqueName: \"kubernetes.io/projected/0bd443bc-e364-4355-976d-c839aa094663-kube-api-access-cfflb\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.872423 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.872284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-oauth-config\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.872423 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.872323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-service-ca\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.872550 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.872453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-console-config\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.873051 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.873027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-service-ca\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.873162 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.873073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-oauth-serving-cert\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.873162 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.873110 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-console-config\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.874697 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.874669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-oauth-config\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.874823 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.874808 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-serving-cert\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.880906 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.880876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfflb\" (UniqueName: \"kubernetes.io/projected/0bd443bc-e364-4355-976d-c839aa094663-kube-api-access-cfflb\") pod \"console-5dff98cf55-z569j\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:22.972875 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.972842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/92c9dbdd-564b-4a82-b0f7-83c095996e80-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2nk99\" (UID: \"92c9dbdd-564b-4a82-b0f7-83c095996e80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:22.975152 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.975122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/92c9dbdd-564b-4a82-b0f7-83c095996e80-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2nk99\" (UID: \"92c9dbdd-564b-4a82-b0f7-83c095996e80\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:22.985021 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:22.984997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:23.109695 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:23.109565 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dff98cf55-z569j"] Jul 21 07:54:23.111828 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:23.111800 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd443bc_e364_4355_976d_c839aa094663.slice/crio-3133bcbef2591a160400fccb7e04bad9e8959b9046b9dbdd3d0b48c854730db8 WatchSource:0}: Error finding container 3133bcbef2591a160400fccb7e04bad9e8959b9046b9dbdd3d0b48c854730db8: Status 404 returned error can't find the container with id 3133bcbef2591a160400fccb7e04bad9e8959b9046b9dbdd3d0b48c854730db8 Jul 21 07:54:23.241276 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:23.241226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:23.362824 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:23.362781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99"] Jul 21 07:54:23.365420 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:23.365394 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c9dbdd_564b_4a82_b0f7_83c095996e80.slice/crio-6bf41bd3b392ad78324122e34ae22cce2960668eceb7180464a04d2c2b49e0ba WatchSource:0}: Error finding container 6bf41bd3b392ad78324122e34ae22cce2960668eceb7180464a04d2c2b49e0ba: Status 404 returned error can't find the container with id 6bf41bd3b392ad78324122e34ae22cce2960668eceb7180464a04d2c2b49e0ba Jul 21 07:54:23.489349 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:23.489314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" event={"ID":"92c9dbdd-564b-4a82-b0f7-83c095996e80","Type":"ContainerStarted","Data":"6bf41bd3b392ad78324122e34ae22cce2960668eceb7180464a04d2c2b49e0ba"} Jul 21 07:54:23.490426 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:23.490397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dff98cf55-z569j" event={"ID":"0bd443bc-e364-4355-976d-c839aa094663","Type":"ContainerStarted","Data":"3133bcbef2591a160400fccb7e04bad9e8959b9046b9dbdd3d0b48c854730db8"} Jul 21 07:54:23.625076 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:23.625008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:25.501327 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:25.501277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" event={"ID":"92c9dbdd-564b-4a82-b0f7-83c095996e80","Type":"ContainerStarted","Data":"fde0a285ebb8b6c1c2b8a75cd8eaff8eb1c54fb120f14b5fded1cd8f2c5fae49"} Jul 21 07:54:25.501768 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:25.501526 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:25.507072 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:25.507049 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" Jul 21 07:54:25.517547 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:25.517506 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2nk99" podStartSLOduration=2.059313723 podStartE2EDuration="3.517491446s" totalImagesPullingTime="1.458177723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:25.516353366 +0000 UTC m=+293.356673084" watchObservedRunningTime="2026-07-21 07:54:25.517491446 +0000 UTC m=+293.357811163" Jul 21 07:54:26.352658 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:26.352556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:26.418848 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:26.418812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:26.506560 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:26.506519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dff98cf55-z569j" event={"ID":"0bd443bc-e364-4355-976d-c839aa094663","Type":"ContainerStarted","Data":"8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854"} Jul 21 07:54:26.524499 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:26.524454 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dff98cf55-z569j" podStartSLOduration=1.65806689 podStartE2EDuration="4.524440741s" totalImagesPullingTime="2.866373851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:26.524081192 +0000 UTC m=+294.364400918" watchObservedRunningTime="2026-07-21 07:54:26.524440741 +0000 UTC m=+294.364760456" Jul 21 07:54:26.575545 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:26.575512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:26.675805 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:26.675774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:27.647409 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:54:27.647364 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g8w8j" podUID="c2c025f9-945a-43b0-904d-f7e6d763c836" Jul 21 07:54:27.654872 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:27.654843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:27.711316 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:27.711281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:28.366583 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:28.366545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:28.467547 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:28.467515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:30.503100 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.503064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:30.659526 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.659492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:30.746020 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.745983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:30.746413 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.746393 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7qk8v"] Jul 21 07:54:30.749076 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.749056 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.751430 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.751412 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 07:54:30.752773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.752420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 07:54:30.752773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.752429 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 07:54:30.752773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.752525 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nm279\"" Jul 21 07:54:30.752773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.752427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 07:54:30.754108 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.754057 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zsh84"] Jul 21 07:54:30.757459 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.757433 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.759922 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.759829 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 07:54:30.759922 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.759913 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 07:54:30.761152 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.761135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 07:54:30.761255 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.761153 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5x6bg\"" Jul 21 07:54:30.762036 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.762018 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7qk8v"] Jul 21 07:54:30.842290 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cede4c78-7837-4919-bdf2-49442643681c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.842457 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-tls\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842457 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-wtmp\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842457 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842457 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cede4c78-7837-4919-bdf2-49442643681c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.842683 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-sys\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842683 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-root\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842683 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-textfile\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842683 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvvwt\" (UniqueName: \"kubernetes.io/projected/5a7fb75f-f199-466a-8eb9-6b43cceef464-kube-api-access-vvvwt\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842893 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a7fb75f-f199-466a-8eb9-6b43cceef464-metrics-client-ca\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842893 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.842893 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.842893 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.842893 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.842893 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.842873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpcv\" (UniqueName: \"kubernetes.io/projected/cede4c78-7837-4919-bdf2-49442643681c-kube-api-access-zhpcv\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.848370 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.848343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:30.910709 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.910677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:30.943825 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.943778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvvwt\" (UniqueName: \"kubernetes.io/projected/5a7fb75f-f199-466a-8eb9-6b43cceef464-kube-api-access-vvvwt\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.943825 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.943833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a7fb75f-f199-466a-8eb9-6b43cceef464-metrics-client-ca\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944065 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.943946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.944065 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.943978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.944065 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944242 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.944299 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpcv\" (UniqueName: \"kubernetes.io/projected/cede4c78-7837-4919-bdf2-49442643681c-kube-api-access-zhpcv\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.944351 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cede4c78-7837-4919-bdf2-49442643681c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.944403 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-tls\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944403 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-wtmp\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944505 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944505 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cede4c78-7837-4919-bdf2-49442643681c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.944505 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-sys\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944648 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-root\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944648 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-textfile\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944648 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a7fb75f-f199-466a-8eb9-6b43cceef464-metrics-client-ca\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-sys\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.944822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.944768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-root\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.945208 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.945011 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cede4c78-7837-4919-bdf2-49442643681c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.945995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.945055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-wtmp\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.945995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.945364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-textfile\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.946177 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.945449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-accelerators-collector-config\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.946177 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.945933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cede4c78-7837-4919-bdf2-49442643681c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.946899 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.946567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.947171 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.947122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.947494 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.947459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.947577 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.947497 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cede4c78-7837-4919-bdf2-49442643681c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.947656 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.947637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a7fb75f-f199-466a-8eb9-6b43cceef464-node-exporter-tls\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.952402 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.952375 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvvwt\" (UniqueName: \"kubernetes.io/projected/5a7fb75f-f199-466a-8eb9-6b43cceef464-kube-api-access-vvvwt\") pod \"node-exporter-zsh84\" (UID: \"5a7fb75f-f199-466a-8eb9-6b43cceef464\") " pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:30.952574 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.952554 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpcv\" (UniqueName: \"kubernetes.io/projected/cede4c78-7837-4919-bdf2-49442643681c-kube-api-access-zhpcv\") pod \"kube-state-metrics-56c5594674-7qk8v\" (UID: \"cede4c78-7837-4919-bdf2-49442643681c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:30.976530 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:30.976494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:31.059029 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.058932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" Jul 21 07:54:31.068943 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.068914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zsh84" Jul 21 07:54:31.082568 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:31.082530 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7fb75f_f199_466a_8eb9_6b43cceef464.slice/crio-00788d2492a3e79b1c2c9ca7403b812c503e89f2db768501e354def85464efd8 WatchSource:0}: Error finding container 00788d2492a3e79b1c2c9ca7403b812c503e89f2db768501e354def85464efd8: Status 404 returned error can't find the container with id 00788d2492a3e79b1c2c9ca7403b812c503e89f2db768501e354def85464efd8 Jul 21 07:54:31.083654 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.083087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:31.177924 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.177886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:31.204524 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.204502 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7qk8v"] Jul 21 07:54:31.206876 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:31.206844 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcede4c78_7837_4919_bdf2_49442643681c.slice/crio-3b832eca159c7bb5f333fea3c420d24803d338af1cbd3f7afbaeb2531922bf43 WatchSource:0}: Error finding container 3b832eca159c7bb5f333fea3c420d24803d338af1cbd3f7afbaeb2531922bf43: Status 404 returned error can't find the container with id 3b832eca159c7bb5f333fea3c420d24803d338af1cbd3f7afbaeb2531922bf43 Jul 21 07:54:31.487404 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.487373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v8trp" Jul 21 07:54:31.526164 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.526126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" event={"ID":"cede4c78-7837-4919-bdf2-49442643681c","Type":"ContainerStarted","Data":"3b832eca159c7bb5f333fea3c420d24803d338af1cbd3f7afbaeb2531922bf43"} Jul 21 07:54:31.527312 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.527279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsh84" event={"ID":"5a7fb75f-f199-466a-8eb9-6b43cceef464","Type":"ContainerStarted","Data":"00788d2492a3e79b1c2c9ca7403b812c503e89f2db768501e354def85464efd8"} Jul 21 07:54:31.543545 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.543513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:31.728212 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.728139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:31.835103 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:31.833717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:32.062425 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.062388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:32.444648 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.444608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:32.545480 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.545440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:32.636375 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.636355 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 07:54:32.644575 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.644547 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:32.985528 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.985496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:32.985719 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.985565 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:32.990684 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:32.990661 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:33.536277 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.536240 2578 generic.go:356] "Generic (PLEG): container finished" podID="5a7fb75f-f199-466a-8eb9-6b43cceef464" containerID="fd6e02baa856053b7909b4d503285bbd77a363ade9cd35e86383c1716b1d35b7" exitCode=0 Jul 21 07:54:33.536457 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.536327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsh84" event={"ID":"5a7fb75f-f199-466a-8eb9-6b43cceef464","Type":"ContainerDied","Data":"fd6e02baa856053b7909b4d503285bbd77a363ade9cd35e86383c1716b1d35b7"} Jul 21 07:54:33.538783 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.538750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" event={"ID":"cede4c78-7837-4919-bdf2-49442643681c","Type":"ContainerStarted","Data":"3b6c5450ba188fd493c48e18386c36d5412e39e7384831b3f9d2af5cdb88c539"} Jul 21 07:54:33.538909 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.538805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" event={"ID":"cede4c78-7837-4919-bdf2-49442643681c","Type":"ContainerStarted","Data":"414e805dd50703d17236efe88389dafd2a28212a2cc13083a8e895606b392bcc"} Jul 21 07:54:33.538909 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.538831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" event={"ID":"cede4c78-7837-4919-bdf2-49442643681c","Type":"ContainerStarted","Data":"6e1e827c7ff88e6f37c4ee5d684b9db65a934d74ecb56589519351b237cb57c8"} Jul 21 07:54:33.542673 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.542651 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:54:33.600185 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.600133 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-7qk8v" podStartSLOduration=2.196606144 podStartE2EDuration="3.600113793s" totalImagesPullingTime="1.403507649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:33.596576645 +0000 UTC m=+301.436896391" watchObservedRunningTime="2026-07-21 07:54:33.600113793 +0000 UTC m=+301.440433510" Jul 21 07:54:33.816183 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.816104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:33.867642 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.867608 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-859574bb68-k5784"] Jul 21 07:54:33.871323 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.871302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.874249 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-j97k7\"" Jul 21 07:54:33.874249 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 07:54:33.874498 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3m10gumss9agf\"" Jul 21 07:54:33.874498 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 07:54:33.874498 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874396 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 07:54:33.874498 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 07:54:33.874815 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.874585 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 07:54:33.885166 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.885147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-859574bb68-k5784"] Jul 21 07:54:33.905291 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.905245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:33.971688 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdgd9\" (UniqueName: \"kubernetes.io/projected/c4c96c19-00ad-4175-8353-1c41ee435147-kube-api-access-fdgd9\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.971868 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-tls\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.971868 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.971868 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.972025 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c96c19-00ad-4175-8353-1c41ee435147-metrics-client-ca\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.972025 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.972025 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.971938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-grpc-tls\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:33.972025 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:33.972013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.072639 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.072639 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdgd9\" (UniqueName: \"kubernetes.io/projected/c4c96c19-00ad-4175-8353-1c41ee435147-kube-api-access-fdgd9\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.072865 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-tls\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.072865 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.072865 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.072865 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c96c19-00ad-4175-8353-1c41ee435147-metrics-client-ca\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.073063 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.073063 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.072919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-grpc-tls\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.073796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.073772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c96c19-00ad-4175-8353-1c41ee435147-metrics-client-ca\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.075679 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.075654 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-tls\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.075811 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.075703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.075882 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.075857 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.075960 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.075939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.075995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.075954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.075995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.075952 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4c96c19-00ad-4175-8353-1c41ee435147-secret-grpc-tls\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.082801 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.082782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdgd9\" (UniqueName: \"kubernetes.io/projected/c4c96c19-00ad-4175-8353-1c41ee435147-kube-api-access-fdgd9\") pod \"thanos-querier-859574bb68-k5784\" (UID: \"c4c96c19-00ad-4175-8353-1c41ee435147\") " pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.099592 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.099566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:34.182889 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.182858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:34.201044 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.201013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:34.315046 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.314975 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-859574bb68-k5784"] Jul 21 07:54:34.317055 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:34.317031 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c96c19_00ad_4175_8353_1c41ee435147.slice/crio-6ca6f10761ab209b3ae8ec1457a9ade41cf276145854dbfa22d90405c52bbe8a WatchSource:0}: Error finding container 6ca6f10761ab209b3ae8ec1457a9ade41cf276145854dbfa22d90405c52bbe8a: Status 404 returned error can't find the container with id 6ca6f10761ab209b3ae8ec1457a9ade41cf276145854dbfa22d90405c52bbe8a Jul 21 07:54:34.319230 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.319211 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 07:54:34.543789 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.543757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsh84" event={"ID":"5a7fb75f-f199-466a-8eb9-6b43cceef464","Type":"ContainerStarted","Data":"d7bbf157265c6bb07466321a35d996bb08d19736942546fdea373a9b99efc4b3"} Jul 21 07:54:34.543980 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.543808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zsh84" event={"ID":"5a7fb75f-f199-466a-8eb9-6b43cceef464","Type":"ContainerStarted","Data":"1b801f39bc16787439db11548c6ee30566f70056abe8d92854413047c96fa1f8"} Jul 21 07:54:34.544990 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.544960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"6ca6f10761ab209b3ae8ec1457a9ade41cf276145854dbfa22d90405c52bbe8a"} Jul 21 07:54:34.561395 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:34.561349 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zsh84" podStartSLOduration=2.94972847 podStartE2EDuration="4.561334764s" totalImagesPullingTime="1.51969865s" totalInitContainerRuntime="91.907644ms" isStatefulPod=true podCreationTimestamp="2026-07-21 07:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:34.560506876 +0000 UTC m=+302.400826591" watchObservedRunningTime="2026-07-21 07:54:34.561334764 +0000 UTC m=+302.401654479" Jul 21 07:54:35.171510 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:35.171476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:35.278135 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:35.278099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:35.523247 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:35.523168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:35.593797 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:35.593758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:35.955950 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:35.955878 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:36.033894 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:36.033855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:36.554103 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:36.554072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"5bbdeca21879113d3a149f15d83ad6dcb9287b4f8d6cf05bcc8015c4effcfa59"} Jul 21 07:54:37.090031 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.089994 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:37.439204 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.439169 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:37.539325 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.539279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:37.559739 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.559700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"ca53732f36fa5d99a0756d5f16456e7acfa29705faa331d0b23683aa742fa912"} Jul 21 07:54:37.560070 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.559778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"1853a2654b79b0da0f4463817ee1f189d7c449306c968af4135e531d1f8a5939"} Jul 21 07:54:37.560070 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.559804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"a9c6bf2ebd61cd5d8ba7d3770b18e8320332739a35d992e67cabc2b76369c0f5"} Jul 21 07:54:37.675799 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.675777 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:37.780774 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:37.780667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:38.465827 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.465799 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fd44879bd-2m9tj" Jul 21 07:54:38.481415 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.481386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:38.565897 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.565862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"d6adcedaaea96dd96018fc9552a137afbb8b43be48afc683aca7750cca96c254"} Jul 21 07:54:38.566289 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.565926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" event={"ID":"c4c96c19-00ad-4175-8353-1c41ee435147","Type":"ContainerStarted","Data":"1694753f20ea2af2a125634d5d4db7633f6f6138e6a1e421a74333ee9144f30c"} Jul 21 07:54:38.566289 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.566043 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:38.581552 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.581516 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:38.593413 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.593361 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" podStartSLOduration=2.6078315549999997 podStartE2EDuration="5.59334475s" totalImagesPullingTime="2.985513195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:54:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:38.591699458 +0000 UTC m=+306.432019176" watchObservedRunningTime="2026-07-21 07:54:38.59334475 +0000 UTC m=+306.433664501" Jul 21 07:54:38.649878 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.649836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:38.747659 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.747577 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:38.845665 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:38.845638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:39.392954 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.392921 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b97d7f6c7-jwpk9"] Jul 21 07:54:39.396352 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.396331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.404591 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.404567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 07:54:39.408873 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.408851 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b97d7f6c7-jwpk9"] Jul 21 07:54:39.524665 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-config\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.524665 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-trusted-ca-bundle\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.524869 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-oauth-serving-cert\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.524869 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-service-ca\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.524869 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-oauth-config\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.524869 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtpw\" (UniqueName: \"kubernetes.io/projected/cf7a8512-a290-4752-b9b3-02217fc59bb3-kube-api-access-tjtpw\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.525009 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.524893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-serving-cert\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.625535 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtpw\" (UniqueName: \"kubernetes.io/projected/cf7a8512-a290-4752-b9b3-02217fc59bb3-kube-api-access-tjtpw\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.625535 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-serving-cert\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626088 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-config\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626088 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-trusted-ca-bundle\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626088 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-oauth-serving-cert\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626088 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-service-ca\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626088 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.625700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-oauth-config\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626465 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.626434 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-config\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626561 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.626492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-oauth-serving-cert\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626615 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.626569 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-service-ca\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.626747 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.626713 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-trusted-ca-bundle\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.628111 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.628088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-oauth-config\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.628252 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.628236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-serving-cert\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.646400 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.646347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:54:39.646647 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.646620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtpw\" (UniqueName: \"kubernetes.io/projected/cf7a8512-a290-4752-b9b3-02217fc59bb3-kube-api-access-tjtpw\") pod \"console-7b97d7f6c7-jwpk9\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.705381 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.705346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:39.839675 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:39.839535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b97d7f6c7-jwpk9"] Jul 21 07:54:39.841845 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:54:39.841821 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7a8512_a290_4752_b9b3_02217fc59bb3.slice/crio-7b618df82d801398a82652454837d74905cd83c19e4f1d3e87d6801627b5c5fe WatchSource:0}: Error finding container 7b618df82d801398a82652454837d74905cd83c19e4f1d3e87d6801627b5c5fe: Status 404 returned error can't find the container with id 7b618df82d801398a82652454837d74905cd83c19e4f1d3e87d6801627b5c5fe Jul 21 07:54:40.575173 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:40.575135 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b97d7f6c7-jwpk9" event={"ID":"cf7a8512-a290-4752-b9b3-02217fc59bb3","Type":"ContainerStarted","Data":"b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928"} Jul 21 07:54:40.575365 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:40.575182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b97d7f6c7-jwpk9" event={"ID":"cf7a8512-a290-4752-b9b3-02217fc59bb3","Type":"ContainerStarted","Data":"7b618df82d801398a82652454837d74905cd83c19e4f1d3e87d6801627b5c5fe"} Jul 21 07:54:40.596922 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:40.596871 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b97d7f6c7-jwpk9" podStartSLOduration=1.596856879 podStartE2EDuration="1.596856879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:54:40.595889093 +0000 UTC m=+308.436208809" watchObservedRunningTime="2026-07-21 07:54:40.596856879 +0000 UTC m=+308.437176594" Jul 21 07:54:40.614698 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:40.614673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:40.670075 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:40.670031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:44.575437 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:44.575407 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-859574bb68-k5784" Jul 21 07:54:49.706400 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:49.706367 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:49.706847 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:49.706451 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:49.711138 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:49.711118 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:50.612799 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:50.612766 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:54:50.658708 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:50.658676 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dff98cf55-z569j"] Jul 21 07:54:50.756897 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:50.756866 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:50.857082 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:50.857045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:50.960458 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:50.960422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:55.937124 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:55.937094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:55.990233 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:55.990206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:54:56.633096 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:56.633060 2578 generic.go:356] "Generic (PLEG): container finished" podID="0aeff430-4375-4a33-9c98-ef22ef041223" containerID="2f1bd8d77d31ba0c53aed1a0ff3f03df41fb47107bd0a9090dc7e0833e22477f" exitCode=0 Jul 21 07:54:56.633303 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:56.633129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" event={"ID":"0aeff430-4375-4a33-9c98-ef22ef041223","Type":"ContainerDied","Data":"2f1bd8d77d31ba0c53aed1a0ff3f03df41fb47107bd0a9090dc7e0833e22477f"} Jul 21 07:54:56.633479 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:56.633466 2578 scope.go:117] "RemoveContainer" containerID="2f1bd8d77d31ba0c53aed1a0ff3f03df41fb47107bd0a9090dc7e0833e22477f" Jul 21 07:54:57.638782 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:54:57.638683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jnh8d" event={"ID":"0aeff430-4375-4a33-9c98-ef22ef041223","Type":"ContainerStarted","Data":"c5d7c76fef2fae86bc8a906141b3c97dbe1ca931dd2fd702ae52156991b21db2"} Jul 21 07:55:05.964513 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:05.964473 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:06.021935 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:06.021903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:10.683936 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:10.683904 2578 generic.go:356] "Generic (PLEG): container finished" podID="ee3355fe-5f12-4366-8650-55cb0e1d5008" containerID="19b7097da5f1ae8614e8c262dcd2ebec7396735116ce09ca5a4ab46cb8e6d1b6" exitCode=0 Jul 21 07:55:10.684268 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:10.683951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" event={"ID":"ee3355fe-5f12-4366-8650-55cb0e1d5008","Type":"ContainerDied","Data":"19b7097da5f1ae8614e8c262dcd2ebec7396735116ce09ca5a4ab46cb8e6d1b6"} Jul 21 07:55:10.684268 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:10.684254 2578 scope.go:117] "RemoveContainer" containerID="19b7097da5f1ae8614e8c262dcd2ebec7396735116ce09ca5a4ab46cb8e6d1b6" Jul 21 07:55:11.689258 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:11.689225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pf2zq" event={"ID":"ee3355fe-5f12-4366-8650-55cb0e1d5008","Type":"ContainerStarted","Data":"e353b4aa45da0bf2dfff08d6e25790c5678e3d9ce62d38de5aac76cd627357e6"} Jul 21 07:55:15.678788 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:15.678745 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dff98cf55-z569j" podUID="0bd443bc-e364-4355-976d-c839aa094663" containerName="console" containerID="cri-o://8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854" gracePeriod=15 Jul 21 07:55:15.920204 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:15.920179 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:55:16.021538 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021472 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-console-config\") pod \"0bd443bc-e364-4355-976d-c839aa094663\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " Jul 21 07:55:16.021538 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021511 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-oauth-config\") pod \"0bd443bc-e364-4355-976d-c839aa094663\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " Jul 21 07:55:16.021758 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021542 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfflb\" (UniqueName: \"kubernetes.io/projected/0bd443bc-e364-4355-976d-c839aa094663-kube-api-access-cfflb\") pod \"0bd443bc-e364-4355-976d-c839aa094663\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " Jul 21 07:55:16.021758 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021654 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-service-ca\") pod \"0bd443bc-e364-4355-976d-c839aa094663\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " Jul 21 07:55:16.021758 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021692 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-oauth-serving-cert\") pod \"0bd443bc-e364-4355-976d-c839aa094663\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " Jul 21 07:55:16.021923 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021760 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-serving-cert\") pod \"0bd443bc-e364-4355-976d-c839aa094663\" (UID: \"0bd443bc-e364-4355-976d-c839aa094663\") " Jul 21 07:55:16.022020 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021963 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-console-config" (OuterVolumeSpecName: "console-config") pod "0bd443bc-e364-4355-976d-c839aa094663" (UID: "0bd443bc-e364-4355-976d-c839aa094663"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:55:16.022071 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.021993 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-service-ca" (OuterVolumeSpecName: "service-ca") pod "0bd443bc-e364-4355-976d-c839aa094663" (UID: "0bd443bc-e364-4355-976d-c839aa094663"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:55:16.022132 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.022112 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0bd443bc-e364-4355-976d-c839aa094663" (UID: "0bd443bc-e364-4355-976d-c839aa094663"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:55:16.023775 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.023752 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0bd443bc-e364-4355-976d-c839aa094663" (UID: "0bd443bc-e364-4355-976d-c839aa094663"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:55:16.023872 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.023797 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0bd443bc-e364-4355-976d-c839aa094663" (UID: "0bd443bc-e364-4355-976d-c839aa094663"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:55:16.023966 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.023944 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd443bc-e364-4355-976d-c839aa094663-kube-api-access-cfflb" (OuterVolumeSpecName: "kube-api-access-cfflb") pod "0bd443bc-e364-4355-976d-c839aa094663" (UID: "0bd443bc-e364-4355-976d-c839aa094663"). InnerVolumeSpecName "kube-api-access-cfflb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:55:16.122477 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.122450 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-serving-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:55:16.122477 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.122476 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-console-config\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:55:16.122639 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.122488 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd443bc-e364-4355-976d-c839aa094663-console-oauth-config\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:55:16.122639 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.122500 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfflb\" (UniqueName: \"kubernetes.io/projected/0bd443bc-e364-4355-976d-c839aa094663-kube-api-access-cfflb\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:55:16.122639 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.122515 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-service-ca\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:55:16.122639 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.122525 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd443bc-e364-4355-976d-c839aa094663-oauth-serving-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:55:16.708492 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.708459 2578 generic.go:356] "Generic (PLEG): container finished" podID="0bd443bc-e364-4355-976d-c839aa094663" containerID="8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854" exitCode=0 Jul 21 07:55:16.708877 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.708501 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dff98cf55-z569j" Jul 21 07:55:16.708877 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.708542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dff98cf55-z569j" event={"ID":"0bd443bc-e364-4355-976d-c839aa094663","Type":"ContainerDied","Data":"8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854"} Jul 21 07:55:16.708877 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.708589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dff98cf55-z569j" event={"ID":"0bd443bc-e364-4355-976d-c839aa094663","Type":"ContainerDied","Data":"3133bcbef2591a160400fccb7e04bad9e8959b9046b9dbdd3d0b48c854730db8"} Jul 21 07:55:16.708877 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.708620 2578 scope.go:117] "RemoveContainer" containerID="8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854" Jul 21 07:55:16.716953 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.716923 2578 scope.go:117] "RemoveContainer" containerID="8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854" Jul 21 07:55:16.717214 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:55:16.717194 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854\": container with ID starting with 8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854 not found: ID does not exist" containerID="8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854" Jul 21 07:55:16.717260 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.717224 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854"} err="failed to get container status \"8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854\": rpc error: code = NotFound desc = could not find container \"8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854\": container with ID starting with 8c65116e7966509e354f81ce7f1779fe43ecfb7aa1a1764e327c83266c9e5854 not found: ID does not exist" Jul 21 07:55:16.724546 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.724521 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dff98cf55-z569j"] Jul 21 07:55:16.732845 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:16.729873 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dff98cf55-z569j"] Jul 21 07:55:18.651434 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:18.651396 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd443bc-e364-4355-976d-c839aa094663" path="/var/lib/kubelet/pods/0bd443bc-e364-4355-976d-c839aa094663/volumes" Jul 21 07:55:29.950796 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:29.950685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:30.039897 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:30.039863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:46.379314 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.379268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:55:46.381520 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.381496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c025f9-945a-43b0-904d-f7e6d763c836-metrics-certs\") pod \"network-metrics-daemon-g8w8j\" (UID: \"c2c025f9-945a-43b0-904d-f7e6d763c836\") " pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:55:46.549668 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.549635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gpmnn\"" Jul 21 07:55:46.557546 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.557524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8w8j" Jul 21 07:55:46.690254 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.689562 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8w8j"] Jul 21 07:55:46.825805 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.825757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8w8j" event={"ID":"c2c025f9-945a-43b0-904d-f7e6d763c836","Type":"ContainerStarted","Data":"41f87b720e4dc82dd3c6b10d0c839b3a908db41d864f108580d6af44eea5e882"} Jul 21 07:55:46.958494 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:46.958463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:47.079169 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:47.079131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:47.831649 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:47.831615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8w8j" event={"ID":"c2c025f9-945a-43b0-904d-f7e6d763c836","Type":"ContainerStarted","Data":"231227ef3d82692e26a1c5ca315126f0cb9812925946dc9e0e7c90d7afe6d4f5"} Jul 21 07:55:48.837054 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:48.837015 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8w8j" event={"ID":"c2c025f9-945a-43b0-904d-f7e6d763c836","Type":"ContainerStarted","Data":"0aa0970b7a3a1a7c1dac291443e8899245406c1bfc8352deb1ff1a8ee95208ec"} Jul 21 07:55:48.853947 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:48.853899 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g8w8j" podStartSLOduration=374.813179698 podStartE2EDuration="6m15.853883999s" totalImagesPullingTime="1.040704301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:55:48.853013802 +0000 UTC m=+376.693333519" watchObservedRunningTime="2026-07-21 07:55:48.853883999 +0000 UTC m=+376.694203715" Jul 21 07:55:48.963191 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:48.963156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:49.064614 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:49.064578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:54.262053 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:54.261990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:54.373089 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:54.373050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:54.471581 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:54.471547 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:54.983403 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:54.983366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:55.084286 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:55.084254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:56.483995 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:56.483961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:56.594853 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:56.594822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:58.961875 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:58.961844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:55:59.064357 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:55:59.064327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:05.038667 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:05.038627 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b97d7f6c7-jwpk9"] Jul 21 07:56:05.177198 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:05.177161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:05.279976 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:05.279939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:05.344550 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:05.344478 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:05.973833 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:05.973798 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:06.076524 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:06.076488 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:22.999427 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:22.999393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:30.061932 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.061871 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b97d7f6c7-jwpk9" podUID="cf7a8512-a290-4752-b9b3-02217fc59bb3" containerName="console" containerID="cri-o://b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928" gracePeriod=15 Jul 21 07:56:30.300024 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.300000 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:56:30.418539 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-oauth-config\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.418709 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418558 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-service-ca\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.418709 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418633 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-trusted-ca-bundle\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.418709 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418661 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjtpw\" (UniqueName: \"kubernetes.io/projected/cf7a8512-a290-4752-b9b3-02217fc59bb3-kube-api-access-tjtpw\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.418709 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418690 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-serving-cert\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.418957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418747 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-config\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.418957 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.418778 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-oauth-serving-cert\") pod \"cf7a8512-a290-4752-b9b3-02217fc59bb3\" (UID: \"cf7a8512-a290-4752-b9b3-02217fc59bb3\") " Jul 21 07:56:30.419088 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.419053 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:56:30.419153 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.419071 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:56:30.419286 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.419252 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-config" (OuterVolumeSpecName: "console-config") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:56:30.419352 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.419318 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 07:56:30.420692 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.420668 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:56:30.421239 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.421208 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:56:30.421239 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.421219 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7a8512-a290-4752-b9b3-02217fc59bb3-kube-api-access-tjtpw" (OuterVolumeSpecName: "kube-api-access-tjtpw") pod "cf7a8512-a290-4752-b9b3-02217fc59bb3" (UID: "cf7a8512-a290-4752-b9b3-02217fc59bb3"). InnerVolumeSpecName "kube-api-access-tjtpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:56:30.520240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520190 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-config\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.520240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520234 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-oauth-serving-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.520240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520248 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-oauth-config\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.520240 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520257 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-service-ca\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.520496 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520266 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7a8512-a290-4752-b9b3-02217fc59bb3-trusted-ca-bundle\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.520496 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520274 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjtpw\" (UniqueName: \"kubernetes.io/projected/cf7a8512-a290-4752-b9b3-02217fc59bb3-kube-api-access-tjtpw\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.520496 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.520283 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7a8512-a290-4752-b9b3-02217fc59bb3-console-serving-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:56:30.994255 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.994216 2578 generic.go:356] "Generic (PLEG): container finished" podID="cf7a8512-a290-4752-b9b3-02217fc59bb3" containerID="b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928" exitCode=0 Jul 21 07:56:30.994422 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.994264 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b97d7f6c7-jwpk9" Jul 21 07:56:30.994422 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.994269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b97d7f6c7-jwpk9" event={"ID":"cf7a8512-a290-4752-b9b3-02217fc59bb3","Type":"ContainerDied","Data":"b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928"} Jul 21 07:56:30.994422 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.994392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b97d7f6c7-jwpk9" event={"ID":"cf7a8512-a290-4752-b9b3-02217fc59bb3","Type":"ContainerDied","Data":"7b618df82d801398a82652454837d74905cd83c19e4f1d3e87d6801627b5c5fe"} Jul 21 07:56:30.994422 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:30.994422 2578 scope.go:117] "RemoveContainer" containerID="b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928" Jul 21 07:56:31.003143 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:31.003095 2578 scope.go:117] "RemoveContainer" containerID="b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928" Jul 21 07:56:31.003409 ip-10-0-131-166 kubenswrapper[2578]: E0721 07:56:31.003374 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928\": container with ID starting with b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928 not found: ID does not exist" containerID="b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928" Jul 21 07:56:31.003492 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:31.003423 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928"} err="failed to get container status \"b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928\": rpc error: code = NotFound desc = could not find container \"b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928\": container with ID starting with b7fa17e3931206863ce9454c13c6da409bb2eb5044fd199ad6a7ca523d9eb928 not found: ID does not exist" Jul 21 07:56:31.012379 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:31.012356 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b97d7f6c7-jwpk9"] Jul 21 07:56:31.018295 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:31.018272 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b97d7f6c7-jwpk9"] Jul 21 07:56:32.652004 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:32.651964 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7a8512-a290-4752-b9b3-02217fc59bb3" path="/var/lib/kubelet/pods/cf7a8512-a290-4752-b9b3-02217fc59bb3/volumes" Jul 21 07:56:41.917375 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:41.917330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:56:41.975811 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:56:41.975781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:29.543408 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:29.543370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:29.641548 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:29.641514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:30.209748 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.209697 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn"] Jul 21 07:57:30.210040 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.210026 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7a8512-a290-4752-b9b3-02217fc59bb3" containerName="console" Jul 21 07:57:30.210083 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.210042 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7a8512-a290-4752-b9b3-02217fc59bb3" containerName="console" Jul 21 07:57:30.210083 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.210063 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd443bc-e364-4355-976d-c839aa094663" containerName="console" Jul 21 07:57:30.210083 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.210069 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd443bc-e364-4355-976d-c839aa094663" containerName="console" Jul 21 07:57:30.210176 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.210111 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd443bc-e364-4355-976d-c839aa094663" containerName="console" Jul 21 07:57:30.210176 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.210120 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7a8512-a290-4752-b9b3-02217fc59bb3" containerName="console" Jul 21 07:57:30.213137 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.213120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.215708 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.215693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 07:57:30.216538 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.216517 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g4kfl\"" Jul 21 07:57:30.216538 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.216530 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 07:57:30.222452 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.222425 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn"] Jul 21 07:57:30.278296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.278263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8zk\" (UniqueName: \"kubernetes.io/projected/fe8c4800-9b71-4458-a5c0-aa794598e6e1-kube-api-access-wb8zk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.278296 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.278300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.278508 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.278321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.379632 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.379591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8zk\" (UniqueName: \"kubernetes.io/projected/fe8c4800-9b71-4458-a5c0-aa794598e6e1-kube-api-access-wb8zk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.379632 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.379635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.379899 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.379661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.380054 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.380029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.380130 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.380086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.391826 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.391801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8zk\" (UniqueName: \"kubernetes.io/projected/fe8c4800-9b71-4458-a5c0-aa794598e6e1-kube-api-access-wb8zk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.522826 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.522701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:30.656759 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:30.656713 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn"] Jul 21 07:57:30.660090 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:57:30.660062 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8c4800_9b71_4458_a5c0_aa794598e6e1.slice/crio-94a9f3bdd0ccb829ee8f469f74112ab50d8f5adac4073b87fe5697d742507ce1 WatchSource:0}: Error finding container 94a9f3bdd0ccb829ee8f469f74112ab50d8f5adac4073b87fe5697d742507ce1: Status 404 returned error can't find the container with id 94a9f3bdd0ccb829ee8f469f74112ab50d8f5adac4073b87fe5697d742507ce1 Jul 21 07:57:31.225819 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:31.225781 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" event={"ID":"fe8c4800-9b71-4458-a5c0-aa794598e6e1","Type":"ContainerStarted","Data":"94a9f3bdd0ccb829ee8f469f74112ab50d8f5adac4073b87fe5697d742507ce1"} Jul 21 07:57:37.251456 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:37.251424 2578 generic.go:356] "Generic (PLEG): container finished" podID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerID="5e03e33c50d43691861e7affdb1b6b7868e046ce4ceeed7c5e25ab83ff58d57b" exitCode=0 Jul 21 07:57:37.251864 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:37.251519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" event={"ID":"fe8c4800-9b71-4458-a5c0-aa794598e6e1","Type":"ContainerDied","Data":"5e03e33c50d43691861e7affdb1b6b7868e046ce4ceeed7c5e25ab83ff58d57b"} Jul 21 07:57:40.264488 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:40.264443 2578 generic.go:356] "Generic (PLEG): container finished" podID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerID="6b121e83150485318d18ac3d31730b24318c224ed06e31529f5d6055bc6821a5" exitCode=0 Jul 21 07:57:40.264488 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:40.264492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" event={"ID":"fe8c4800-9b71-4458-a5c0-aa794598e6e1","Type":"ContainerDied","Data":"6b121e83150485318d18ac3d31730b24318c224ed06e31529f5d6055bc6821a5"} Jul 21 07:57:47.295010 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:47.294964 2578 generic.go:356] "Generic (PLEG): container finished" podID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerID="14630f01f3f40f778b550de3e7dd989ab1a70c85ea90cc7a885c098c10556b40" exitCode=0 Jul 21 07:57:47.295406 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:47.295044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" event={"ID":"fe8c4800-9b71-4458-a5c0-aa794598e6e1","Type":"ContainerDied","Data":"14630f01f3f40f778b550de3e7dd989ab1a70c85ea90cc7a885c098c10556b40"} Jul 21 07:57:48.423510 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.423484 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:48.545130 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.545079 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-util\") pod \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " Jul 21 07:57:48.545322 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.545178 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-bundle\") pod \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " Jul 21 07:57:48.545322 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.545217 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb8zk\" (UniqueName: \"kubernetes.io/projected/fe8c4800-9b71-4458-a5c0-aa794598e6e1-kube-api-access-wb8zk\") pod \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\" (UID: \"fe8c4800-9b71-4458-a5c0-aa794598e6e1\") " Jul 21 07:57:48.545936 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.545911 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-bundle" (OuterVolumeSpecName: "bundle") pod "fe8c4800-9b71-4458-a5c0-aa794598e6e1" (UID: "fe8c4800-9b71-4458-a5c0-aa794598e6e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:57:48.547405 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.547373 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe8c4800-9b71-4458-a5c0-aa794598e6e1-kube-api-access-wb8zk" (OuterVolumeSpecName: "kube-api-access-wb8zk") pod "fe8c4800-9b71-4458-a5c0-aa794598e6e1" (UID: "fe8c4800-9b71-4458-a5c0-aa794598e6e1"). InnerVolumeSpecName "kube-api-access-wb8zk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:57:48.550462 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.550403 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-util" (OuterVolumeSpecName: "util") pod "fe8c4800-9b71-4458-a5c0-aa794598e6e1" (UID: "fe8c4800-9b71-4458-a5c0-aa794598e6e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:57:48.645830 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.645798 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-util\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:57:48.645830 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.645823 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe8c4800-9b71-4458-a5c0-aa794598e6e1-bundle\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:57:48.645830 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:48.645832 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb8zk\" (UniqueName: \"kubernetes.io/projected/fe8c4800-9b71-4458-a5c0-aa794598e6e1-kube-api-access-wb8zk\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 07:57:49.304287 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:49.304261 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" Jul 21 07:57:49.304455 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:49.304255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dnnn" event={"ID":"fe8c4800-9b71-4458-a5c0-aa794598e6e1","Type":"ContainerDied","Data":"94a9f3bdd0ccb829ee8f469f74112ab50d8f5adac4073b87fe5697d742507ce1"} Jul 21 07:57:49.304455 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:49.304380 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94a9f3bdd0ccb829ee8f469f74112ab50d8f5adac4073b87fe5697d742507ce1" Jul 21 07:57:51.171154 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:51.171115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:51.968494 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:51.968463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:53.164304 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164267 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7"] Jul 21 07:57:53.164822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164692 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="util" Jul 21 07:57:53.164822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164713 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="util" Jul 21 07:57:53.164822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164769 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="pull" Jul 21 07:57:53.164822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164779 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="pull" Jul 21 07:57:53.164822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164792 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="extract" Jul 21 07:57:53.164822 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164800 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="extract" Jul 21 07:57:53.165120 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.164882 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8c4800-9b71-4458-a5c0-aa794598e6e1" containerName="extract" Jul 21 07:57:53.166974 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.166953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.169292 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.169267 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 21 07:57:53.169292 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.169273 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dm4jg\"" Jul 21 07:57:53.169430 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.169322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 21 07:57:53.180305 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.180281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7"] Jul 21 07:57:53.282921 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.282875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33df981-f2a3-400b-8e34-57e3ca10cf02-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-gcxd7\" (UID: \"c33df981-f2a3-400b-8e34-57e3ca10cf02\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.282921 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.282924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc8zn\" (UniqueName: \"kubernetes.io/projected/c33df981-f2a3-400b-8e34-57e3ca10cf02-kube-api-access-vc8zn\") pod \"cert-manager-operator-controller-manager-56b4598547-gcxd7\" (UID: \"c33df981-f2a3-400b-8e34-57e3ca10cf02\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.383978 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.383937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33df981-f2a3-400b-8e34-57e3ca10cf02-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-gcxd7\" (UID: \"c33df981-f2a3-400b-8e34-57e3ca10cf02\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.383978 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.383982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc8zn\" (UniqueName: \"kubernetes.io/projected/c33df981-f2a3-400b-8e34-57e3ca10cf02-kube-api-access-vc8zn\") pod \"cert-manager-operator-controller-manager-56b4598547-gcxd7\" (UID: \"c33df981-f2a3-400b-8e34-57e3ca10cf02\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.384306 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.384288 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33df981-f2a3-400b-8e34-57e3ca10cf02-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-gcxd7\" (UID: \"c33df981-f2a3-400b-8e34-57e3ca10cf02\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.391919 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.391897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc8zn\" (UniqueName: \"kubernetes.io/projected/c33df981-f2a3-400b-8e34-57e3ca10cf02-kube-api-access-vc8zn\") pod \"cert-manager-operator-controller-manager-56b4598547-gcxd7\" (UID: \"c33df981-f2a3-400b-8e34-57e3ca10cf02\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.475932 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.475857 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" Jul 21 07:57:53.602526 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:53.602494 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7"] Jul 21 07:57:53.607221 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:57:53.607188 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33df981_f2a3_400b_8e34_57e3ca10cf02.slice/crio-88b98c057a019d53f5f7de3df49ce602f46991f3ad6993f55b6c8ab1bb4c78e3 WatchSource:0}: Error finding container 88b98c057a019d53f5f7de3df49ce602f46991f3ad6993f55b6c8ab1bb4c78e3: Status 404 returned error can't find the container with id 88b98c057a019d53f5f7de3df49ce602f46991f3ad6993f55b6c8ab1bb4c78e3 Jul 21 07:57:54.325744 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:54.325687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" event={"ID":"c33df981-f2a3-400b-8e34-57e3ca10cf02","Type":"ContainerStarted","Data":"88b98c057a019d53f5f7de3df49ce602f46991f3ad6993f55b6c8ab1bb4c78e3"} Jul 21 07:57:54.781086 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:54.781046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:54.839498 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:54.839464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:55.331901 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:55.331859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" event={"ID":"c33df981-f2a3-400b-8e34-57e3ca10cf02","Type":"ContainerStarted","Data":"3e6e84b85dda9c734bd21e52b2a2e9e0b4d972c8981ce884d64ff4226b6ae702"} Jul 21 07:57:55.351540 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:55.351471 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-gcxd7" podStartSLOduration=0.774773923 podStartE2EDuration="2.351454628s" totalImagesPullingTime="1.576680705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:57:55.350266176 +0000 UTC m=+503.190585892" watchObservedRunningTime="2026-07-21 07:57:55.351454628 +0000 UTC m=+503.191774344" Jul 21 07:57:57.114703 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:57.114652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:57.172297 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:57.172260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:59.135411 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.135372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:59.416891 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.416853 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mvrql"] Jul 21 07:57:59.420410 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.420387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.422853 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.422833 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 07:57:59.423591 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.423573 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-46x4q\"" Jul 21 07:57:59.423695 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.423578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 07:57:59.429833 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.429815 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mvrql"] Jul 21 07:57:59.519834 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.519801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:59.535024 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.534999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgffd\" (UniqueName: \"kubernetes.io/projected/5cd5b254-1d92-4657-87f0-ba7c4910bd69-kube-api-access-tgffd\") pod \"cert-manager-cainjector-559cdd8c87-mvrql\" (UID: \"5cd5b254-1d92-4657-87f0-ba7c4910bd69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.535134 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.535026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cd5b254-1d92-4657-87f0-ba7c4910bd69-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mvrql\" (UID: \"5cd5b254-1d92-4657-87f0-ba7c4910bd69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.620351 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.620315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:59.635922 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.635900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgffd\" (UniqueName: \"kubernetes.io/projected/5cd5b254-1d92-4657-87f0-ba7c4910bd69-kube-api-access-tgffd\") pod \"cert-manager-cainjector-559cdd8c87-mvrql\" (UID: \"5cd5b254-1d92-4657-87f0-ba7c4910bd69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.635993 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.635928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cd5b254-1d92-4657-87f0-ba7c4910bd69-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mvrql\" (UID: \"5cd5b254-1d92-4657-87f0-ba7c4910bd69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.644285 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.644259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cd5b254-1d92-4657-87f0-ba7c4910bd69-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mvrql\" (UID: \"5cd5b254-1d92-4657-87f0-ba7c4910bd69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.644496 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.644474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgffd\" (UniqueName: \"kubernetes.io/projected/5cd5b254-1d92-4657-87f0-ba7c4910bd69-kube-api-access-tgffd\") pod \"cert-manager-cainjector-559cdd8c87-mvrql\" (UID: \"5cd5b254-1d92-4657-87f0-ba7c4910bd69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.674133 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.674078 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:57:59.730070 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.730044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" Jul 21 07:57:59.854353 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:57:59.854324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mvrql"] Jul 21 07:57:59.857152 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:57:59.857128 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cd5b254_1d92_4657_87f0_ba7c4910bd69.slice/crio-f7ad595aae066ae3957a72a74f4833dea65ec1d71244fb0d4b5963e069722927 WatchSource:0}: Error finding container f7ad595aae066ae3957a72a74f4833dea65ec1d71244fb0d4b5963e069722927: Status 404 returned error can't find the container with id f7ad595aae066ae3957a72a74f4833dea65ec1d71244fb0d4b5963e069722927 Jul 21 07:58:00.353521 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:00.353486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" event={"ID":"5cd5b254-1d92-4657-87f0-ba7c4910bd69","Type":"ContainerStarted","Data":"f7ad595aae066ae3957a72a74f4833dea65ec1d71244fb0d4b5963e069722927"} Jul 21 07:58:07.304378 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.304344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:07.388683 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.388651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" event={"ID":"5cd5b254-1d92-4657-87f0-ba7c4910bd69","Type":"ContainerStarted","Data":"9483bcb11263ea00658857e9af345ddb07067a3475e686c87e32ee195f70d420"} Jul 21 07:58:07.404361 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.404317 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mvrql" podStartSLOduration=1.7293522449999998 podStartE2EDuration="8.404301688s" totalImagesPullingTime="6.674949443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:58:07.403595025 +0000 UTC m=+515.243914753" watchObservedRunningTime="2026-07-21 07:58:07.404301688 +0000 UTC m=+515.244621403" Jul 21 07:58:07.404773 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.404752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:07.717748 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.717702 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d4r7b"] Jul 21 07:58:07.720935 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.720915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:07.723353 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.723334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hd2c8\"" Jul 21 07:58:07.730390 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.730370 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d4r7b"] Jul 21 07:58:07.744416 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.744390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:07.798664 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.798636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcd4fe9-d179-4d5b-96bc-630438a399d8-bound-sa-token\") pod \"cert-manager-55b4d954d5-d4r7b\" (UID: \"cfcd4fe9-d179-4d5b-96bc-630438a399d8\") " pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:07.798834 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.798752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrsgj\" (UniqueName: \"kubernetes.io/projected/cfcd4fe9-d179-4d5b-96bc-630438a399d8-kube-api-access-wrsgj\") pod \"cert-manager-55b4d954d5-d4r7b\" (UID: \"cfcd4fe9-d179-4d5b-96bc-630438a399d8\") " pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:07.899994 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.899959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrsgj\" (UniqueName: \"kubernetes.io/projected/cfcd4fe9-d179-4d5b-96bc-630438a399d8-kube-api-access-wrsgj\") pod \"cert-manager-55b4d954d5-d4r7b\" (UID: \"cfcd4fe9-d179-4d5b-96bc-630438a399d8\") " pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:07.900181 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.900010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcd4fe9-d179-4d5b-96bc-630438a399d8-bound-sa-token\") pod \"cert-manager-55b4d954d5-d4r7b\" (UID: \"cfcd4fe9-d179-4d5b-96bc-630438a399d8\") " pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:07.908366 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.908341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcd4fe9-d179-4d5b-96bc-630438a399d8-bound-sa-token\") pod \"cert-manager-55b4d954d5-d4r7b\" (UID: \"cfcd4fe9-d179-4d5b-96bc-630438a399d8\") " pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:07.908459 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:07.908444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrsgj\" (UniqueName: \"kubernetes.io/projected/cfcd4fe9-d179-4d5b-96bc-630438a399d8-kube-api-access-wrsgj\") pod \"cert-manager-55b4d954d5-d4r7b\" (UID: \"cfcd4fe9-d179-4d5b-96bc-630438a399d8\") " pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:08.030834 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.030719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d4r7b" Jul 21 07:58:08.153753 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.153713 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d4r7b"] Jul 21 07:58:08.155478 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:58:08.155448 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfcd4fe9_d179_4d5b_96bc_630438a399d8.slice/crio-1e3fadc8fbb559d4361ad941cba69b4fb0644f9e78d7abfcf8e0fb905de13545 WatchSource:0}: Error finding container 1e3fadc8fbb559d4361ad941cba69b4fb0644f9e78d7abfcf8e0fb905de13545: Status 404 returned error can't find the container with id 1e3fadc8fbb559d4361ad941cba69b4fb0644f9e78d7abfcf8e0fb905de13545 Jul 21 07:58:08.393976 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.393878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d4r7b" event={"ID":"cfcd4fe9-d179-4d5b-96bc-630438a399d8","Type":"ContainerStarted","Data":"06f63a122f6ab6228df0612faf363cc8733d22ffb440e33ccb49c1cf5ad65b0e"} Jul 21 07:58:08.393976 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.393932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d4r7b" event={"ID":"cfcd4fe9-d179-4d5b-96bc-630438a399d8","Type":"ContainerStarted","Data":"1e3fadc8fbb559d4361ad941cba69b4fb0644f9e78d7abfcf8e0fb905de13545"} Jul 21 07:58:08.412231 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.412185 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d4r7b" podStartSLOduration=1.4121703079999999 podStartE2EDuration="1.412170308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:58:08.411072052 +0000 UTC m=+516.251391769" watchObservedRunningTime="2026-07-21 07:58:08.412170308 +0000 UTC m=+516.252490023" Jul 21 07:58:08.615017 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.614978 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:08.715252 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:08.715219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:10.030346 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:10.030309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:26.665501 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:26.665424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:26.726110 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:26.726078 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:26.790242 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:26.790216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:29.796774 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:29.796742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:32.601014 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:32.600966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:32.700593 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:32.700535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:39.837008 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:39.836966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:40.239979 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:40.239939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:40.298020 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:40.297980 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:42.255014 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:42.254976 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:43.741096 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:43.741062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:58:43.840809 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:58:43.840775 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:40.626961 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.626926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:40.735699 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.735669 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8"] Jul 21 07:59:40.738820 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.738803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.741081 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.741054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-nvhtw\"" Jul 21 07:59:40.742036 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.742019 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 21 07:59:40.742165 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.742096 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 21 07:59:40.748482 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.748453 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8"] Jul 21 07:59:40.848616 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.848584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3a7d8af-5956-47a1-8611-65d118a39753-tmp\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.848814 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.848622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/f3a7d8af-5956-47a1-8611-65d118a39753-manifests-work\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.848814 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.848712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwthx\" (UniqueName: \"kubernetes.io/projected/f3a7d8af-5956-47a1-8611-65d118a39753-kube-api-access-lwthx\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.950165 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.950139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwthx\" (UniqueName: \"kubernetes.io/projected/f3a7d8af-5956-47a1-8611-65d118a39753-kube-api-access-lwthx\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.950272 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.950187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3a7d8af-5956-47a1-8611-65d118a39753-tmp\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.950316 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.950299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/f3a7d8af-5956-47a1-8611-65d118a39753-manifests-work\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.950499 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.950479 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3a7d8af-5956-47a1-8611-65d118a39753-tmp\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.950597 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.950581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/f3a7d8af-5956-47a1-8611-65d118a39753-manifests-work\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:40.958119 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:40.958092 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwthx\" (UniqueName: \"kubernetes.io/projected/f3a7d8af-5956-47a1-8611-65d118a39753-kube-api-access-lwthx\") pod \"trainer-operator-controller-manager-7b7b5447fc-4ddr8\" (UID: \"f3a7d8af-5956-47a1-8611-65d118a39753\") " pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:41.050275 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:41.050255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:41.170949 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:41.170922 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8"] Jul 21 07:59:41.172260 ip-10-0-131-166 kubenswrapper[2578]: W0721 07:59:41.172234 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a7d8af_5956_47a1_8611_65d118a39753.slice/crio-af779d0223fa85e8ee9b1f57b1729510de7b7353895b655d10c45835146ca6d5 WatchSource:0}: Error finding container af779d0223fa85e8ee9b1f57b1729510de7b7353895b655d10c45835146ca6d5: Status 404 returned error can't find the container with id af779d0223fa85e8ee9b1f57b1729510de7b7353895b655d10c45835146ca6d5 Jul 21 07:59:41.174290 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:41.174273 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 07:59:41.800865 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:41.800829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" event={"ID":"f3a7d8af-5956-47a1-8611-65d118a39753","Type":"ContainerStarted","Data":"af779d0223fa85e8ee9b1f57b1729510de7b7353895b655d10c45835146ca6d5"} Jul 21 07:59:41.817939 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:41.817908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:43.812662 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:43.812625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" event={"ID":"f3a7d8af-5956-47a1-8611-65d118a39753","Type":"ContainerStarted","Data":"51a540316b4e30fa7d85ba690637ae01d56d93475dedaa3d13b027f17580f258"} Jul 21 07:59:43.813135 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:43.812789 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:43.828314 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:43.828268 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" podStartSLOduration=1.295204281 podStartE2EDuration="3.828249487s" totalImagesPullingTime="2.533045206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:59:43.826079145 +0000 UTC m=+611.666398861" watchObservedRunningTime="2026-07-21 07:59:43.828249487 +0000 UTC m=+611.668569205" Jul 21 07:59:44.321046 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:44.321008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:44.399703 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:44.399670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:44.475214 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:44.475166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:44.527463 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:44.527405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:45.070474 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:45.070442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:45.123914 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:45.123875 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 07:59:54.819049 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:54.818968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-7b7b5447fc-4ddr8" Jul 21 07:59:55.045347 ip-10-0-131-166 kubenswrapper[2578]: I0721 07:59:55.045317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:26.683841 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:26.683803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:26.783201 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:26.783166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:28.831019 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:28.830981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:29.073154 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:29.073119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:32.986906 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:32.986871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:50.789867 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.789833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:00:50.811889 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.811860 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-gmj55"] Jul 21 08:00:50.814815 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.814796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:00:50.817078 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.817057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dngbb\"" Jul 21 08:00:50.817157 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.817057 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 08:00:50.817157 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.817107 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 08:00:50.822711 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.822688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-gmj55"] Jul 21 08:00:50.918390 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:50.918367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbr2m\" (UniqueName: \"kubernetes.io/projected/843f9ae9-9159-49f8-a3ce-88bc30f0e868-kube-api-access-bbr2m\") pod \"test-trainjob-workflow-node-0-0-gmj55\" (UID: \"843f9ae9-9159-49f8-a3ce-88bc30f0e868\") " pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:00:51.019550 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:51.019524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbr2m\" (UniqueName: \"kubernetes.io/projected/843f9ae9-9159-49f8-a3ce-88bc30f0e868-kube-api-access-bbr2m\") pod \"test-trainjob-workflow-node-0-0-gmj55\" (UID: \"843f9ae9-9159-49f8-a3ce-88bc30f0e868\") " pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:00:51.027953 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:51.027930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbr2m\" (UniqueName: \"kubernetes.io/projected/843f9ae9-9159-49f8-a3ce-88bc30f0e868-kube-api-access-bbr2m\") pod \"test-trainjob-workflow-node-0-0-gmj55\" (UID: \"843f9ae9-9159-49f8-a3ce-88bc30f0e868\") " pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:00:51.123797 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:51.123750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:00:51.244311 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:51.244267 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-gmj55"] Jul 21 08:00:51.246548 ip-10-0-131-166 kubenswrapper[2578]: W0721 08:00:51.246520 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod843f9ae9_9159_49f8_a3ce_88bc30f0e868.slice/crio-c526e3107084c547b02298d605d8eb034a2799bceae8c0fc0bc5c6c509d63a30 WatchSource:0}: Error finding container c526e3107084c547b02298d605d8eb034a2799bceae8c0fc0bc5c6c509d63a30: Status 404 returned error can't find the container with id c526e3107084c547b02298d605d8eb034a2799bceae8c0fc0bc5c6c509d63a30 Jul 21 08:00:52.100227 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:00:52.100191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" event={"ID":"843f9ae9-9159-49f8-a3ce-88bc30f0e868","Type":"ContainerStarted","Data":"c526e3107084c547b02298d605d8eb034a2799bceae8c0fc0bc5c6c509d63a30"} Jul 21 08:01:13.091949 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:01:13.091914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:02.465203 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:02.465163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" event={"ID":"843f9ae9-9159-49f8-a3ce-88bc30f0e868","Type":"ContainerStarted","Data":"56fd8e48083940aaa73ed4f7fc8956de6a29c53ea64b9b058331c5bebf8e5e3b"} Jul 21 08:02:02.483719 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:02.483671 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" podStartSLOduration=1.998414074 podStartE2EDuration="1m12.483657301s" totalImagesPullingTime="1m10.485243227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:02:02.48171577 +0000 UTC m=+750.322035492" watchObservedRunningTime="2026-07-21 08:02:02.483657301 +0000 UTC m=+750.323977090" Jul 21 08:02:04.476093 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:04.476063 2578 generic.go:356] "Generic (PLEG): container finished" podID="843f9ae9-9159-49f8-a3ce-88bc30f0e868" containerID="56fd8e48083940aaa73ed4f7fc8956de6a29c53ea64b9b058331c5bebf8e5e3b" exitCode=0 Jul 21 08:02:04.476423 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:04.476138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" event={"ID":"843f9ae9-9159-49f8-a3ce-88bc30f0e868","Type":"ContainerDied","Data":"56fd8e48083940aaa73ed4f7fc8956de6a29c53ea64b9b058331c5bebf8e5e3b"} Jul 21 08:02:05.632692 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:05.632666 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:02:05.771058 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:05.771002 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbr2m\" (UniqueName: \"kubernetes.io/projected/843f9ae9-9159-49f8-a3ce-88bc30f0e868-kube-api-access-bbr2m\") pod \"843f9ae9-9159-49f8-a3ce-88bc30f0e868\" (UID: \"843f9ae9-9159-49f8-a3ce-88bc30f0e868\") " Jul 21 08:02:05.773047 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:05.773023 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843f9ae9-9159-49f8-a3ce-88bc30f0e868-kube-api-access-bbr2m" (OuterVolumeSpecName: "kube-api-access-bbr2m") pod "843f9ae9-9159-49f8-a3ce-88bc30f0e868" (UID: "843f9ae9-9159-49f8-a3ce-88bc30f0e868"). InnerVolumeSpecName "kube-api-access-bbr2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:02:05.871421 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:05.871398 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbr2m\" (UniqueName: \"kubernetes.io/projected/843f9ae9-9159-49f8-a3ce-88bc30f0e868-kube-api-access-bbr2m\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 08:02:06.486456 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:06.486428 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" Jul 21 08:02:06.486600 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:06.486454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-gmj55" event={"ID":"843f9ae9-9159-49f8-a3ce-88bc30f0e868","Type":"ContainerDied","Data":"c526e3107084c547b02298d605d8eb034a2799bceae8c0fc0bc5c6c509d63a30"} Jul 21 08:02:06.486600 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:06.486492 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c526e3107084c547b02298d605d8eb034a2799bceae8c0fc0bc5c6c509d63a30" Jul 21 08:02:07.064388 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.064350 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-gmj55"] Jul 21 08:02:07.066108 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.066085 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-gmj55"] Jul 21 08:02:07.088203 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.088170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:07.196184 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.196155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:07.298113 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.298091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:07.397440 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.397369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:07.465548 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:07.465494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:08.276899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.276871 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjlhl/must-gather-fnszh"] Jul 21 08:02:08.277325 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.277160 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="843f9ae9-9159-49f8-a3ce-88bc30f0e868" containerName="node" Jul 21 08:02:08.277325 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.277170 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="843f9ae9-9159-49f8-a3ce-88bc30f0e868" containerName="node" Jul 21 08:02:08.277325 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.277221 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="843f9ae9-9159-49f8-a3ce-88bc30f0e868" containerName="node" Jul 21 08:02:08.291043 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.291010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:08.319292 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.319265 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjlhl/must-gather-fnszh"] Jul 21 08:02:08.319395 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.319354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.321908 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.321888 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjlhl\"/\"kube-root-ca.crt\"" Jul 21 08:02:08.321908 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.321902 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjlhl\"/\"openshift-service-ca.crt\"" Jul 21 08:02:08.322061 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.321888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjlhl\"/\"default-dockercfg-bj88q\"" Jul 21 08:02:08.349434 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.349412 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:02:08.390124 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.390100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-must-gather-output\") pod \"must-gather-fnszh\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.390204 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.390155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhmq\" (UniqueName: \"kubernetes.io/projected/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-kube-api-access-4bhmq\") pod \"must-gather-fnszh\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.491454 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.491427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhmq\" (UniqueName: \"kubernetes.io/projected/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-kube-api-access-4bhmq\") pod \"must-gather-fnszh\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.491581 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.491492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-must-gather-output\") pod \"must-gather-fnszh\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.491861 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.491844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-must-gather-output\") pod \"must-gather-fnszh\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.500297 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.500275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhmq\" (UniqueName: \"kubernetes.io/projected/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-kube-api-access-4bhmq\") pod \"must-gather-fnszh\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.627864 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.627814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:02:08.652800 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.652779 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="843f9ae9-9159-49f8-a3ce-88bc30f0e868" path="/var/lib/kubelet/pods/843f9ae9-9159-49f8-a3ce-88bc30f0e868/volumes" Jul 21 08:02:08.774194 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:08.774172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjlhl/must-gather-fnszh"] Jul 21 08:02:08.776317 ip-10-0-131-166 kubenswrapper[2578]: W0721 08:02:08.776289 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4f2ff13_3b79_4d05_9663_e0d1f6a6838e.slice/crio-c239d5070d712108f40bbdba4434acd2f305e8a58c802fd4c8f5c903bd223cf2 WatchSource:0}: Error finding container c239d5070d712108f40bbdba4434acd2f305e8a58c802fd4c8f5c903bd223cf2: Status 404 returned error can't find the container with id c239d5070d712108f40bbdba4434acd2f305e8a58c802fd4c8f5c903bd223cf2 Jul 21 08:02:09.500672 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:09.500630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjlhl/must-gather-fnszh" event={"ID":"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e","Type":"ContainerStarted","Data":"c239d5070d712108f40bbdba4434acd2f305e8a58c802fd4c8f5c903bd223cf2"} Jul 21 08:02:16.542435 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:16.542399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjlhl/must-gather-fnszh" event={"ID":"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e","Type":"ContainerStarted","Data":"7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22"} Jul 21 08:02:17.548541 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:17.548487 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjlhl/must-gather-fnszh" event={"ID":"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e","Type":"ContainerStarted","Data":"fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1"} Jul 21 08:02:17.563866 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:02:17.563820 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjlhl/must-gather-fnszh" podStartSLOduration=2.018219233 podStartE2EDuration="9.563804395s" totalImagesPullingTime="7.545585162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:02:17.562840101 +0000 UTC m=+765.403159818" watchObservedRunningTime="2026-07-21 08:02:17.563804395 +0000 UTC m=+765.404124111" Jul 21 08:03:01.760795 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:01.760760 2578 generic.go:356] "Generic (PLEG): container finished" podID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerID="7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22" exitCode=0 Jul 21 08:03:01.761182 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:01.760817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjlhl/must-gather-fnszh" event={"ID":"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e","Type":"ContainerDied","Data":"7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22"} Jul 21 08:03:01.761182 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:01.761109 2578 scope.go:117] "RemoveContainer" containerID="7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22" Jul 21 08:03:02.184158 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:02.184128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pjlhl_must-gather-fnszh_b4f2ff13-3b79-4d05-9663-e0d1f6a6838e/gather/0.log" Jul 21 08:03:02.527383 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:02.527302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:03:02.668719 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:02.668686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:03:02.722661 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:02.722634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:03:05.393367 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:05.393327 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tc2b5_682bcf3d-f2f6-4fd8-aac1-4b63509436d9/global-pull-secret-syncer/0.log" Jul 21 08:03:05.436281 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:05.436248 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" Jul 21 08:03:05.533905 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:05.533880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-166.ec2.internal_9e5bd059099eaa7be4523cc656d99f14/haproxy/0.log" Jul 21 08:03:06.848233 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:06.848197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:03:07.497075 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.497045 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-pjlhl/must-gather-fnszh"] Jul 21 08:03:07.497255 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.497235 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-pjlhl/must-gather-fnszh" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="copy" containerID="cri-o://fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1" gracePeriod=2 Jul 21 08:03:07.499594 ip-10-0-131-166 kubenswrapper[2578]: E0721 08:03:07.499554 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fnszh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pjlhl\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:03:07.500198 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.500158 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-pjlhl/must-gather-fnszh"] Jul 21 08:03:07.726248 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.726225 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pjlhl_must-gather-fnszh_b4f2ff13-3b79-4d05-9663-e0d1f6a6838e/copy/0.log" Jul 21 08:03:07.727739 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.727711 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:03:07.729618 ip-10-0-131-166 kubenswrapper[2578]: E0721 08:03:07.729592 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fnszh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pjlhl\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:03:07.789416 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.789359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pjlhl_must-gather-fnszh_b4f2ff13-3b79-4d05-9663-e0d1f6a6838e/copy/0.log" Jul 21 08:03:07.789714 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.789696 2578 generic.go:356] "Generic (PLEG): container finished" podID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerID="fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1" exitCode=143 Jul 21 08:03:07.789818 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.789759 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:03:07.789818 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.789788 2578 scope.go:117] "RemoveContainer" containerID="fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1" Jul 21 08:03:07.791712 ip-10-0-131-166 kubenswrapper[2578]: E0721 08:03:07.791689 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fnszh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pjlhl\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:03:07.796813 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.796796 2578 scope.go:117] "RemoveContainer" containerID="7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22" Jul 21 08:03:07.806852 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.806832 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bhmq\" (UniqueName: \"kubernetes.io/projected/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-kube-api-access-4bhmq\") pod \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " Jul 21 08:03:07.806935 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.806913 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-must-gather-output\") pod \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\" (UID: \"b4f2ff13-3b79-4d05-9663-e0d1f6a6838e\") " Jul 21 08:03:07.808053 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.808021 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" (UID: "b4f2ff13-3b79-4d05-9663-e0d1f6a6838e"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:03:07.808598 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.808578 2578 scope.go:117] "RemoveContainer" containerID="fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1" Jul 21 08:03:07.808896 ip-10-0-131-166 kubenswrapper[2578]: E0721 08:03:07.808870 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1\": container with ID starting with fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1 not found: ID does not exist" containerID="fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1" Jul 21 08:03:07.808968 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.808907 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1"} err="failed to get container status \"fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1\": rpc error: code = NotFound desc = could not find container \"fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1\": container with ID starting with fb3bee0a0ff9691150fb489ace9719bc5bff13c249d2afe0e7aef2dfaca68dd1 not found: ID does not exist" Jul 21 08:03:07.808968 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.808933 2578 scope.go:117] "RemoveContainer" containerID="7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22" Jul 21 08:03:07.809067 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.808916 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-kube-api-access-4bhmq" (OuterVolumeSpecName: "kube-api-access-4bhmq") pod "b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" (UID: "b4f2ff13-3b79-4d05-9663-e0d1f6a6838e"). InnerVolumeSpecName "kube-api-access-4bhmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:03:07.809197 ip-10-0-131-166 kubenswrapper[2578]: E0721 08:03:07.809178 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22\": container with ID starting with 7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22 not found: ID does not exist" containerID="7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22" Jul 21 08:03:07.809235 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.809204 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22"} err="failed to get container status \"7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22\": rpc error: code = NotFound desc = could not find container \"7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22\": container with ID starting with 7ed14e56ae2a4b766c288ad4f20301edc896e339c7097a6e8cb78de6cbc37c22 not found: ID does not exist" Jul 21 08:03:07.908322 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.908292 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bhmq\" (UniqueName: \"kubernetes.io/projected/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-kube-api-access-4bhmq\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 08:03:07.908322 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:07.908321 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e-must-gather-output\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\"" Jul 21 08:03:08.099904 ip-10-0-131-166 kubenswrapper[2578]: E0721 08:03:08.099877 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fnszh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pjlhl\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" pod="openshift-must-gather-pjlhl/must-gather-fnszh" Jul 21 08:03:08.167885 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:08.167856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:03:08.269185 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:08.269159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rlw2_c3793790-6628-4fc7-b703-ea4a0b0d18d0/konnectivity-agent/0.log" limit=1024 Jul 21 08:03:08.653047 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:08.653007 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" path="/var/lib/kubelet/pods/b4f2ff13-3b79-4d05-9663-e0d1f6a6838e/volumes" Jul 21 08:03:09.441102 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.441078 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-tc54f_6e0291d1-fad3-4e7b-b57d-847ae6f75064/cluster-monitoring-operator/0.log" Jul 21 08:03:09.470169 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.470141 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7qk8v_cede4c78-7837-4919-bdf2-49442643681c/kube-state-metrics/0.log" Jul 21 08:03:09.493379 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.493355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7qk8v_cede4c78-7837-4919-bdf2-49442643681c/kube-rbac-proxy-main/0.log" Jul 21 08:03:09.514256 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.514238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7qk8v_cede4c78-7837-4919-bdf2-49442643681c/kube-rbac-proxy-self/0.log" Jul 21 08:03:09.790512 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.790449 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsh84_5a7fb75f-f199-466a-8eb9-6b43cceef464/node-exporter/0.log" Jul 21 08:03:09.822646 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.822625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsh84_5a7fb75f-f199-466a-8eb9-6b43cceef464/kube-rbac-proxy/0.log" Jul 21 08:03:09.851855 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:09.851835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zsh84_5a7fb75f-f199-466a-8eb9-6b43cceef464/init-textfile/0.log" Jul 21 08:03:10.178926 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.178900 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-2nk99_92c9dbdd-564b-4a82-b0f7-83c095996e80/prometheus-operator-admission-webhook/0.log" Jul 21 08:03:10.290332 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.290310 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-859574bb68-k5784_c4c96c19-00ad-4175-8353-1c41ee435147/thanos-query/0.log" Jul 21 08:03:10.313413 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.313392 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-859574bb68-k5784_c4c96c19-00ad-4175-8353-1c41ee435147/kube-rbac-proxy-web/0.log" Jul 21 08:03:10.335582 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.335565 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-859574bb68-k5784_c4c96c19-00ad-4175-8353-1c41ee435147/kube-rbac-proxy/0.log" Jul 21 08:03:10.358821 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.358799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-859574bb68-k5784_c4c96c19-00ad-4175-8353-1c41ee435147/prom-label-proxy/0.log" Jul 21 08:03:10.380962 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.380942 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-859574bb68-k5784_c4c96c19-00ad-4175-8353-1c41ee435147/kube-rbac-proxy-rules/0.log" Jul 21 08:03:10.402149 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:10.402130 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-859574bb68-k5784_c4c96c19-00ad-4175-8353-1c41ee435147/kube-rbac-proxy-metrics/0.log" Jul 21 08:03:12.973532 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973497 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd"] Jul 21 08:03:12.973899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973794 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="copy" Jul 21 08:03:12.973899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973807 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="copy" Jul 21 08:03:12.973899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973828 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="gather" Jul 21 08:03:12.973899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973834 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="gather" Jul 21 08:03:12.973899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973883 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="gather" Jul 21 08:03:12.973899 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.973893 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f2ff13-3b79-4d05-9663-e0d1f6a6838e" containerName="copy" Jul 21 08:03:12.977464 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.977439 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:12.979698 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.979678 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flzk6\"/\"openshift-service-ca.crt\"" Jul 21 08:03:12.979805 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.979681 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flzk6\"/\"default-dockercfg-s6lnv\"" Jul 21 08:03:12.980598 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.980583 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flzk6\"/\"kube-root-ca.crt\"" Jul 21 08:03:12.983722 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:12.983700 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd"] Jul 21 08:03:13.150558 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.150530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-lib-modules\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.150680 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.150566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-sys\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.150680 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.150622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-proc\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.150680 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.150667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-podres\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.150821 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.150689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89b9\" (UniqueName: \"kubernetes.io/projected/a62fe979-2f94-45e5-8436-aa3f41623159-kube-api-access-f89b9\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252019 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.251952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-proc\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252019 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.251993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-podres\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252145 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f89b9\" (UniqueName: \"kubernetes.io/projected/a62fe979-2f94-45e5-8436-aa3f41623159-kube-api-access-f89b9\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252145 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-lib-modules\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252145 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252071 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-proc\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252145 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-sys\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252266 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-podres\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252266 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-lib-modules\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.252266 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.252194 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a62fe979-2f94-45e5-8436-aa3f41623159-sys\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.259848 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.259824 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89b9\" (UniqueName: \"kubernetes.io/projected/a62fe979-2f94-45e5-8436-aa3f41623159-kube-api-access-f89b9\") pod \"perf-node-gather-daemonset-vb5qd\" (UID: \"a62fe979-2f94-45e5-8436-aa3f41623159\") " pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.287844 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.287821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.408307 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.408273 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd"] Jul 21 08:03:13.411533 ip-10-0-131-166 kubenswrapper[2578]: W0721 08:03:13.411507 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda62fe979_2f94_45e5_8436_aa3f41623159.slice/crio-2afca670d9e5d6670dcd75314a3455e354e930becd7faaa676252a8b66a35a3b WatchSource:0}: Error finding container 2afca670d9e5d6670dcd75314a3455e354e930becd7faaa676252a8b66a35a3b: Status 404 returned error can't find the container with id 2afca670d9e5d6670dcd75314a3455e354e930becd7faaa676252a8b66a35a3b Jul 21 08:03:13.817042 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.816954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" event={"ID":"a62fe979-2f94-45e5-8436-aa3f41623159","Type":"ContainerStarted","Data":"743e10e0379839bb10faea26a563a7fd06d78435d638ba5cc2e5d8ff18b1f97c"} Jul 21 08:03:13.817042 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.817010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" event={"ID":"a62fe979-2f94-45e5-8436-aa3f41623159","Type":"ContainerStarted","Data":"2afca670d9e5d6670dcd75314a3455e354e930becd7faaa676252a8b66a35a3b"} Jul 21 08:03:13.817229 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.817095 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:13.831834 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.831782 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" podStartSLOduration=1.8317668280000001 podStartE2EDuration="1.831766828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:03:13.831199236 +0000 UTC m=+821.671518964" watchObservedRunningTime="2026-07-21 08:03:13.831766828 +0000 UTC m=+821.672086544" Jul 21 08:03:13.921702 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.921668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v8trp_1e73dfe6-a2be-483a-b9dc-86fa373709e0/dns/0.log" Jul 21 08:03:13.941224 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.941200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v8trp_1e73dfe6-a2be-483a-b9dc-86fa373709e0/kube-rbac-proxy/0.log" Jul 21 08:03:13.983131 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:13.983098 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kth4k_619f7e1b-dc9c-4c67-8171-89c8d818fbe5/dns-node-resolver/0.log" Jul 21 08:03:14.402651 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:14.402614 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fd44879bd-2m9tj_90db4979-9a91-42ea-98ea-ec72f9f23af4/registry/0.log" Jul 21 08:03:14.468370 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:14.468339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4p79_b688a809-9200-4960-8e1d-946f12916d5a/node-ca/0.log" Jul 21 08:03:15.473577 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:15.473544 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vvbpl_88edd8f7-ade8-4af6-b44f-5ec67f59e4c4/serve-healthcheck-canary/0.log" Jul 21 08:03:15.794973 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:15.794872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-pf2zq_ee3355fe-5f12-4366-8650-55cb0e1d5008/insights-operator/1.log" Jul 21 08:03:15.795186 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:15.795165 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-pf2zq_ee3355fe-5f12-4366-8650-55cb0e1d5008/insights-operator/0.log" Jul 21 08:03:15.876685 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:15.876642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7j7s_7ce0bb16-7b82-4b34-a322-16fbb2229333/kube-rbac-proxy/0.log" Jul 21 08:03:15.895851 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:15.895813 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7j7s_7ce0bb16-7b82-4b34-a322-16fbb2229333/exporter/0.log" Jul 21 08:03:15.915354 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:15.915331 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7j7s_7ce0bb16-7b82-4b34-a322-16fbb2229333/extractor/0.log" Jul 21 08:03:19.830392 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:19.830366 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-flzk6/perf-node-gather-daemonset-vb5qd" Jul 21 08:03:22.153439 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.153416 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/kube-multus-additional-cni-plugins/0.log" Jul 21 08:03:22.175114 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.175096 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/egress-router-binary-copy/0.log" Jul 21 08:03:22.195704 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.195684 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/cni-plugins/0.log" Jul 21 08:03:22.218450 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.218434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/bond-cni-plugin/0.log" Jul 21 08:03:22.248030 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.248009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/routeoverride-cni/0.log" Jul 21 08:03:22.269879 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.269860 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/whereabouts-cni-bincopy/0.log" Jul 21 08:03:22.292304 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.292259 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xd69x_50f0b4be-fa84-441d-86aa-132e96a547dc/whereabouts-cni/0.log" Jul 21 08:03:22.322390 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.322369 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n6tkl_bab8d59a-b79e-4a46-a366-2a033873dbd6/kube-multus/0.log" Jul 21 08:03:22.370688 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.370667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g8w8j_c2c025f9-945a-43b0-904d-f7e6d763c836/network-metrics-daemon/0.log" Jul 21 08:03:22.393617 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:22.393600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g8w8j_c2c025f9-945a-43b0-904d-f7e6d763c836/kube-rbac-proxy/0.log" Jul 21 08:03:23.391792 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.391764 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/ovn-controller/0.log" Jul 21 08:03:23.412697 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.412675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/ovn-acl-logging/0.log" Jul 21 08:03:23.442852 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.442832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/kube-rbac-proxy-node/0.log" Jul 21 08:03:23.465423 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.465404 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 08:03:23.484367 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.484345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/northd/0.log" Jul 21 08:03:23.505341 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.505321 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/nbdb/0.log" Jul 21 08:03:23.533103 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.533074 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/sbdb/0.log" Jul 21 08:03:23.581403 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:23.581381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxknp_5a8d7bab-db41-40db-ba10-1d4faafff654/ovnkube-controller/0.log" Jul 21 08:03:24.791604 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:24.791575 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qgxlv_3ee22c0f-b518-40c6-a2e5-07800c1ef759/network-check-target-container/0.log" Jul 21 08:03:25.626546 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:25.626519 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6xmz6_5835a4eb-b89e-400c-827f-c7c9d554e259/iptables-alerter/0.log" Jul 21 08:03:26.303572 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:26.303536 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-k2x4c_19d829fa-efbb-4416-b352-1d9fc1a415a5/tuned/0.log" Jul 21 08:03:27.920910 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:27.920877 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-n2d2m_683fa5c6-2442-4ccb-8750-e303bc6ffb68/cluster-samples-operator/0.log" Jul 21 08:03:27.936321 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:27.936302 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-n2d2m_683fa5c6-2442-4ccb-8750-e303bc6ffb68/cluster-samples-operator-watch/0.log" Jul 21 08:03:28.818238 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:28.818206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-jnh8d_0aeff430-4375-4a33-9c98-ef22ef041223/service-ca-operator/1.log" Jul 21 08:03:28.818964 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:28.818946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-jnh8d_0aeff430-4375-4a33-9c98-ef22ef041223/service-ca-operator/0.log" Jul 21 08:03:29.132589 ip-10-0-131-166 kubenswrapper[2578]: I0721 08:03:29.132489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-58598695f7-mtb7n_c5913c42-9ac2-406e-80bf-71627e55dd61/service-ca-controller/0.log"