Jul 02 21:19:03.546631 ip-10-0-141-123 systemd[1]: Starting Kubernetes Kubelet... Jul 02 21:19:04.039254 ip-10-0-141-123 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:19:04.039254 ip-10-0-141-123 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 21:19:04.039254 ip-10-0-141-123 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:19:04.039254 ip-10-0-141-123 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 21:19:04.039254 ip-10-0-141-123 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:19:04.040558 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.040474 2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 21:19:04.045613 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045595 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:19:04.045613 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045612 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045616 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045619 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045622 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045626 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045629 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045632 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045635 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045638 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045640 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045643 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045645 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045648 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045650 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045653 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045656 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045658 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045661 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045665 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:19:04.045681 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045669 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045672 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045676 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045678 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045689 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045692 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045695 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045697 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045700 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045702 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045705 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045707 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045711 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045715 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045717 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045720 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045722 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045725 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045727 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:19:04.046125 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045729 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045732 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045735 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045737 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045739 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045742 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045744 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045748 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045751 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045754 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045756 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045758 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045761 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045763 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045766 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045770 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045772 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045775 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045777 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045780 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:19:04.046639 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045782 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045785 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045787 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045790 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045793 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045795 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045797 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045802 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045804 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045806 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045809 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045811 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045814 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045817 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045819 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045822 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045825 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045827 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045830 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045832 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:19:04.047127 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045835 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045837 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045840 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045842 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045844 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045847 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045850 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045853 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045855 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045858 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045861 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045863 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045866 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045868 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045870 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045873 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045875 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045878 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045880 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:19:04.047632 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.045883 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046631 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046638 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046642 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046646 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046649 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046652 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046655 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046658 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046661 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046663 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046666 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046668 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046671 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046674 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046676 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046679 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046682 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046684 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:19:04.048112 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046688 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046692 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046696 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046698 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046701 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046704 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046707 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046709 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046712 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046715 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046717 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046719 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046722 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046725 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046727 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046730 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046734 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046738 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046741 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:19:04.048602 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046743 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046747 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046749 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046752 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046754 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046757 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046759 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046762 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046764 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046767 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046769 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046772 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046774 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046778 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046780 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046783 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046785 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046788 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046791 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046793 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:19:04.049095 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046796 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046798 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046800 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046803 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046805 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046808 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046811 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046814 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046817 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046819 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046821 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046824 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046826 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046838 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046842 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046845 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046848 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046851 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046854 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:19:04.049605 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046856 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046859 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046861 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046864 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046867 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046870 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046873 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046875 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046878 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046881 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046883 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046886 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046888 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046890 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046893 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046896 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046899 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046901 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046904 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046906 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:19:04.050072 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046909 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046912 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.046914 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047298 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047303 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047306 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047324 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047327 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047330 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047333 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047335 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047338 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047341 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047343 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047346 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047348 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047351 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047357 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047360 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:19:04.050579 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047363 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047366 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047369 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047372 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047375 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047377 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047380 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047383 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047385 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047388 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047391 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047393 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047395 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047398 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047401 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047403 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047406 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047409 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047411 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047414 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:19:04.051043 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047416 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047419 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047421 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047424 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047426 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047429 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047431 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047434 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047436 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047439 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047442 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047445 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047447 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047450 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047452 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047455 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047457 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047460 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047462 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047465 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:19:04.051533 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047467 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047469 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047472 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047475 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047478 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047480 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047483 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047486 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047488 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047490 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047493 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047495 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047498 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047501 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047504 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047507 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047509 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047512 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047514 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047517 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:19:04.052014 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047519 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047522 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047524 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047530 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047532 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047535 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047537 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047540 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047542 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047545 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047547 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047551 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047554 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047556 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047559 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047561 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047564 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047566 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047569 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:19:04.052498 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047571 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047575 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047579 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.047583 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047660 2550 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047668 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047674 2550 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047678 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047683 2550 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047686 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047691 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047695 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047698 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047701 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047705 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047708 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047714 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047717 2550 flags.go:64] FLAG: --cgroup-root="" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047720 2550 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047723 2550 flags.go:64] FLAG: --client-ca-file="" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047725 2550 flags.go:64] FLAG: --cloud-provider="external" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047728 2550 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047733 2550 flags.go:64] FLAG: --cluster-domain="" Jul 02 21:19:04.052963 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047736 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047739 2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047742 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047746 2550 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047749 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047753 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047756 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047759 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047762 2550 flags.go:64] FLAG: --contention-profiling="false" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047765 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047768 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047771 2550 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047774 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047778 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047782 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047784 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047787 2550 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047790 2550 flags.go:64] FLAG: --enable-server="true" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047793 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047797 2550 flags.go:64] FLAG: --event-burst="100" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047800 2550 flags.go:64] FLAG: --event-qps="50" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047806 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047809 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047812 2550 flags.go:64] FLAG: --eviction-hard="" Jul 02 21:19:04.053529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047816 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047820 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047823 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047826 2550 flags.go:64] FLAG: --eviction-soft="" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047829 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047832 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047834 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047837 2550 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047840 2550 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047843 2550 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047845 2550 flags.go:64] FLAG: --feature-gates="" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047849 2550 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047852 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047855 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047858 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047861 2550 flags.go:64] FLAG: --healthz-port="10248" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047864 2550 flags.go:64] FLAG: --help="false" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047867 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047870 2550 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047872 2550 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047875 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047878 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047882 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047884 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 21:19:04.054099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047887 2550 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047890 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047892 2550 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047896 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047898 2550 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047902 2550 flags.go:64] FLAG: --kube-reserved="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047905 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047908 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047911 2550 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047915 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047918 2550 flags.go:64] FLAG: --lock-file="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047921 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047924 2550 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047927 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047936 2550 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047939 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047942 2550 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047945 2550 flags.go:64] FLAG: --logging-format="text" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047948 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047951 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047954 2550 flags.go:64] FLAG: --manifest-url="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047957 2550 flags.go:64] FLAG: --manifest-url-header="" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047961 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047964 2550 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047968 2550 flags.go:64] FLAG: --max-pods="110" Jul 02 21:19:04.054825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047971 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047974 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047978 2550 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047980 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047983 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047986 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047989 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047996 2550 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.047999 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048002 2550 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048004 2550 flags.go:64] FLAG: --pod-cidr="" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048010 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048016 2550 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048020 2550 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048024 2550 flags.go:64] FLAG: --pods-per-core="0" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048026 2550 flags.go:64] FLAG: --port="10250" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048031 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048034 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cb0ba2ccd30d6fe5" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048037 2550 flags.go:64] FLAG: --qos-reserved="" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048039 2550 flags.go:64] FLAG: --read-only-port="10255" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048042 2550 flags.go:64] FLAG: --register-node="true" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048045 2550 flags.go:64] FLAG: --register-with-taints="" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048049 2550 flags.go:64] FLAG: --registry-burst="10" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048052 2550 flags.go:64] FLAG: --registry-qps="5" Jul 02 21:19:04.055464 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048054 2550 flags.go:64] FLAG: --reserved-cpus="" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048057 2550 flags.go:64] FLAG: --reserved-memory="" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048061 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048064 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048067 2550 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048070 2550 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048073 2550 flags.go:64] FLAG: --runonce="false" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048075 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048079 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048082 2550 flags.go:64] FLAG: --seccomp-default="false" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048084 2550 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048087 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048090 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048093 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048096 2550 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048098 2550 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048101 2550 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048104 2550 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048106 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048109 2550 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048113 2550 flags.go:64] FLAG: --system-cgroups="" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048117 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048122 2550 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048125 2550 flags.go:64] FLAG: --tls-cert-file="" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048129 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 21:19:04.056054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048133 2550 flags.go:64] FLAG: --tls-min-version="" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048136 2550 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048139 2550 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048142 2550 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048145 2550 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048148 2550 flags.go:64] FLAG: --v="2" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048152 2550 flags.go:64] FLAG: --version="false" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048155 2550 flags.go:64] FLAG: --vmodule="" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048159 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.048162 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048281 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048284 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048287 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048290 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048293 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048295 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048297 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048301 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048305 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048321 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048324 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:19:04.056679 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048327 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048330 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048332 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048335 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048337 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048340 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048343 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048347 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048350 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048353 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048355 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048358 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048362 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048366 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048368 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048371 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048374 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048377 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048379 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048398 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:19:04.057185 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048401 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048404 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048407 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048410 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048413 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048415 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048418 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048420 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048423 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048426 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048428 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048431 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048434 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048436 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048439 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048441 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048444 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048446 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048449 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048452 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:19:04.057766 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048455 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048458 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048461 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048463 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048466 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048468 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048471 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048473 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048476 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048478 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048481 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048483 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048485 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048488 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048491 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048493 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048497 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048500 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048503 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048506 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:19:04.058293 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048508 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048511 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048514 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048516 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048519 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048522 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048525 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048528 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048530 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048532 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048535 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048539 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048541 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048545 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048547 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048550 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048552 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048555 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048557 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048560 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:19:04.058794 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048562 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048565 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048567 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048570 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048572 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048574 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048577 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.048580 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.049580 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.058236 2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.058250 2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.058269 2550 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.058275 2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058345 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:19:04.059281 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058350 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058353 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058356 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058359 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058361 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058364 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058366 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058369 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058371 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058375 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058378 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058382 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058384 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058387 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058389 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058392 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058394 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058397 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058399 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058402 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:19:04.059650 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058404 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058407 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058410 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058412 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058415 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058417 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058421 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058425 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058428 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058430 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058433 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058435 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058438 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058440 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058444 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058446 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058449 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058451 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058454 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:19:04.060119 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058456 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058460 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058463 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058466 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058470 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058473 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058476 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058479 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058482 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058485 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058487 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058490 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058493 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058496 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058499 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058501 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058504 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058506 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058509 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058511 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:19:04.060587 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058514 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058516 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058519 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058521 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058523 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058526 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058528 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058531 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058533 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058536 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058538 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058541 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058543 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058546 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058548 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058551 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058554 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058556 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058560 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:19:04.061071 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058562 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058565 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058567 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058570 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058572 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058575 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058579 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058582 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058585 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058588 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058590 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058593 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058596 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058598 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058601 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058603 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058605 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058608 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058611 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:19:04.061628 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058613 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.058618 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058720 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058725 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058728 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058731 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058733 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058736 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058738 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058741 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058744 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058746 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058749 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058752 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058754 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:19:04.062084 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058756 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058759 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058761 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058764 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058766 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058768 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058772 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058776 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058780 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058783 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058786 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058789 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058792 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058794 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058797 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058800 2550 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058803 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058805 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058808 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:19:04.062459 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058810 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058813 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058815 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058818 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058820 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058822 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058825 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058827 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058838 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058841 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058844 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058846 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058853 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058855 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058858 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058860 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058864 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058867 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058870 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058872 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:19:04.062935 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058875 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058877 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058880 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058882 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058884 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058887 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058889 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058892 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058894 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058896 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058899 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058901 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058903 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058906 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058908 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058910 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058913 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058915 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058918 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058920 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:19:04.063440 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058923 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058925 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058928 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058930 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058933 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058935 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058938 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058940 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058942 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058945 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058947 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058949 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058952 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058954 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058956 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058959 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058961 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058963 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058966 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058968 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:19:04.063910 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058970 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058973 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058975 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058977 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058980 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058982 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:04.058984 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.058989 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.059093 2550 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.062445 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.063971 2550 server.go:1019] "Starting client certificate rotation" Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.064073 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:19:04.064395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.064113 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:19:04.067175 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.067160 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:19:04.068737 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.068714 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:19:04.086913 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.086880 2550 log.go:25] "Validated CRI v1 runtime API" Jul 02 21:19:04.089099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.089085 2550 log.go:25] "Validated CRI v1 image API" Jul 02 21:19:04.089910 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.089893 2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 21:19:04.092628 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.092596 2550 fs.go:135] Filesystem UUIDs: map[2d8b72e1-0837-4d7b-98d3-0d851460d39f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 db15edd8-32f2-4001-981d-bcd1951f7bb0:/dev/nvme0n1p3] Jul 02 21:19:04.092687 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.092627 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 21:19:04.098447 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.098328 2550 manager.go:216] Machine: {Timestamp:2026-07-02 21:19:04.097716455 +0000 UTC m=+0.398511013 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104987 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2ca1d349b85c88ea569d5a5b7e10 SystemUUID:ec2f2ca1-d349-b85c-88ea-569d5a5b7e10 BootID:629c3150-dadf-4874-9f21-c32a13ae490b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:30:cb:98:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:30:cb:98:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:8e:05:ef:b6:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 21:19:04.098447 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.098442 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 21:19:04.098553 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.098521 2550 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 21:19:04.100195 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.100180 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:19:04.102370 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.102338 2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 21:19:04.102519 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.102376 2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 21:19:04.104044 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.104032 2550 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 21:19:04.104077 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.104048 2550 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 21:19:04.104077 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.104055 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:19:04.104810 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.104799 2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:19:04.106819 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.106808 2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 21:19:04.110383 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110370 2550 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:19:04.110683 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110673 2550 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 21:19:04.110718 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110708 2550 kubelet.go:486] "Attempting to sync node with API server" Jul 02 21:19:04.110745 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110728 2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 21:19:04.110772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110753 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 21:19:04.110772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110769 2550 kubelet.go:398] "Adding apiserver pod source" Jul 02 21:19:04.110821 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.110781 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 21:19:04.111201 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.111189 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:19:04.111243 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.111208 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:19:04.113663 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.113643 2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 21:19:04.115942 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.115923 2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 21:19:04.116032 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.115963 2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 21:19:04.118132 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118119 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 21:19:04.118172 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118139 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 21:19:04.118172 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118146 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 21:19:04.118172 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118151 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 21:19:04.118172 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118161 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 21:19:04.118172 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118166 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 21:19:04.118303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118174 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 21:19:04.118303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118179 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 21:19:04.118303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118187 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 21:19:04.118303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118193 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 21:19:04.118303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118207 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 21:19:04.118303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.118213 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 21:19:04.119943 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.119933 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 21:19:04.120004 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.119945 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 21:19:04.122426 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.122409 2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 21:19:04.122868 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.122818 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 21:19:04.122922 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.122818 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 21:19:04.123123 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.123111 2550 server.go:1268] "Started kubelet" Jul 02 21:19:04.123222 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.123195 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 21:19:04.123366 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.123305 2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 21:19:04.123488 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.123395 2550 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 21:19:04.123719 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.123694 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zfxgs" Jul 02 21:19:04.124135 ip-10-0-141-123 systemd[1]: Started Kubernetes Kubelet. Jul 02 21:19:04.125271 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.125241 2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 21:19:04.127355 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.127325 2550 server.go:310] "Adding debug handlers to kubelet server" Jul 02 21:19:04.130145 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.130129 2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 21:19:04.131912 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.131886 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zfxgs" Jul 02 21:19:04.132087 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.132074 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 21:19:04.132157 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.132073 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 21:19:04.132200 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.132156 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.132918 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.132902 2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 21:19:04.132918 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.132903 2550 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 21:19:04.133215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.132930 2550 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 21:19:04.133215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133002 2550 reconstruct.go:97] "Volume reconstruction finished" Jul 02 21:19:04.133215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133010 2550 reconciler.go:29] "Reconciler: start to sync state" Jul 02 21:19:04.133215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133083 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 21:19:04.133215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133100 2550 factory.go:55] Registering systemd factory Jul 02 21:19:04.133215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133109 2550 factory.go:223] Registration of the systemd container factory successfully Jul 02 21:19:04.133516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133365 2550 factory.go:153] Registering CRI-O factory Jul 02 21:19:04.133516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133379 2550 factory.go:223] Registration of the crio container factory successfully Jul 02 21:19:04.133516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133404 2550 factory.go:103] Registering Raw factory Jul 02 21:19:04.133516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133416 2550 manager.go:1196] Started watching for new ooms in manager Jul 02 21:19:04.133821 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.133801 2550 manager.go:349] Starting recovery of all containers Jul 02 21:19:04.143753 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.143634 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:19:04.145363 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.145343 2550 manager.go:354] Recovery completed Jul 02 21:19:04.147118 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.147094 2550 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 02 21:19:04.147346 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.147306 2550 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-123.ec2.internal\" not found" node="ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.150236 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.150223 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.152847 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.152829 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.152911 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.152865 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.152911 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.152883 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.153460 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.153446 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 21:19:04.153460 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.153458 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 21:19:04.153564 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.153474 2550 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:19:04.153564 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.153520 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.154273 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.154260 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.154350 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.154284 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.154350 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.154293 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.154744 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.154732 2550 policy_none.go:49] "None policy: Start" Jul 02 21:19:04.154775 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.154748 2550 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 21:19:04.154775 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.154758 2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 21:19:04.155806 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.155796 2550 policy_none.go:47] "Start" Jul 02 21:19:04.180932 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.180915 2550 manager.go:337] "Starting Device Plugin manager" Jul 02 21:19:04.181031 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.180947 2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 21:19:04.181031 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.180957 2550 server.go:87] "Starting device plugin registration server" Jul 02 21:19:04.181222 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.181210 2550 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 21:19:04.181281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.181224 2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 21:19:04.181460 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.181429 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 21:19:04.181551 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.181519 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 21:19:04.181551 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.181529 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 21:19:04.181952 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.181935 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 21:19:04.182019 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.181987 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.281887 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.281826 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.283383 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.283057 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.283383 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.283090 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.283383 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.283102 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.283383 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.283128 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.288766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.288736 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 21:19:04.290142 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.290086 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 21:19:04.290142 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.290121 2550 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 21:19:04.290142 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.290140 2550 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 21:19:04.290290 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.290169 2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 21:19:04.292451 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.292433 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:19:04.293302 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.293286 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.293379 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.293327 2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-123.ec2.internal\": node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.320687 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.320665 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.391049 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.390999 2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal"] Jul 02 21:19:04.391167 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.391102 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.392053 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.392034 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.392153 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.392068 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.392153 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.392081 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.393585 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.393570 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.393709 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.393693 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.393756 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.393728 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.394292 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.394275 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.394377 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.394301 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.394377 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.394283 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.394377 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.394351 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.394377 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.394362 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.394514 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.394329 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.395746 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.395732 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.395812 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.395757 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:19:04.396429 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.396413 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:19:04.396540 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.396443 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:19:04.396540 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.396458 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:19:04.418062 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.418037 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-123.ec2.internal\" not found" node="ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.421458 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.421432 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.421603 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.421591 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-123.ec2.internal\" not found" node="ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.434249 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.434222 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7c519ecbb7e86b3494895d9cd797fde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"b7c519ecbb7e86b3494895d9cd797fde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.434354 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.434257 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7c519ecbb7e86b3494895d9cd797fde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"b7c519ecbb7e86b3494895d9cd797fde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.434354 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.434281 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc8b346ff26bd2da637db45021bfde3d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-123.ec2.internal\" (UID: \"bc8b346ff26bd2da637db45021bfde3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.522231 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.522200 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.534776 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.534751 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7c519ecbb7e86b3494895d9cd797fde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"b7c519ecbb7e86b3494895d9cd797fde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.534853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.534779 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7c519ecbb7e86b3494895d9cd797fde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"b7c519ecbb7e86b3494895d9cd797fde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.534853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.534799 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc8b346ff26bd2da637db45021bfde3d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-123.ec2.internal\" (UID: \"bc8b346ff26bd2da637db45021bfde3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.534853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.534847 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc8b346ff26bd2da637db45021bfde3d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-123.ec2.internal\" (UID: \"bc8b346ff26bd2da637db45021bfde3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.534995 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.534886 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7c519ecbb7e86b3494895d9cd797fde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"b7c519ecbb7e86b3494895d9cd797fde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.534995 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.534890 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7c519ecbb7e86b3494895d9cd797fde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"b7c519ecbb7e86b3494895d9cd797fde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.622835 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.622725 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.728287 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.728237 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.728415 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:04.728344 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 02 21:19:04.728415 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.728249 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.828725 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.828686 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:04.929457 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:04.929377 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:05.035660 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:05.035629 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:05.063112 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.063086 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 21:19:05.063770 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.063250 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 21:19:05.063770 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.063271 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 21:19:05.136287 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:05.136245 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:05.136287 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.136271 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:14:05 +0000 UTC" deadline="2027-12-29 19:38:24.42828669 +0000 UTC" Jul 02 21:19:05.136515 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.136299 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13078h19m19.291991213s" Jul 02 21:19:05.177870 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.177842 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:19:05.236971 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:05.236934 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 02 21:19:05.289045 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.289018 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:19:05.308261 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:05.308227 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8b346ff26bd2da637db45021bfde3d.slice/crio-002780b768220ff5c4335854283e42aa984c7ce83b680206171fcd4f73bfa76f WatchSource:0}: Error finding container 002780b768220ff5c4335854283e42aa984c7ce83b680206171fcd4f73bfa76f: Status 404 returned error can't find the container with id 002780b768220ff5c4335854283e42aa984c7ce83b680206171fcd4f73bfa76f Jul 02 21:19:05.308691 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:05.308672 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c519ecbb7e86b3494895d9cd797fde.slice/crio-b655625f7293cc61b910750682b43a51037dbfd9b17a17d523abc6b0597933b6 WatchSource:0}: Error finding container b655625f7293cc61b910750682b43a51037dbfd9b17a17d523abc6b0597933b6: Status 404 returned error can't find the container with id b655625f7293cc61b910750682b43a51037dbfd9b17a17d523abc6b0597933b6 Jul 02 21:19:05.314485 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.314471 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:19:05.333412 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.333367 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 02 21:19:05.346889 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.346864 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:19:05.348170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.348154 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 02 21:19:05.357823 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.357808 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:19:05.950733 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:05.950571 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:19:06.111396 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.111365 2550 apiserver.go:52] "Watching apiserver" Jul 02 21:19:06.124326 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.124268 2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 21:19:06.127083 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.127037 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-4vkrs","openshift-network-diagnostics/network-check-target-jsb68","openshift-network-operator/iptables-alerter-bbfk4","kube-system/konnectivity-agent-mt8fl","openshift-cluster-node-tuning-operator/tuned-kckxl","openshift-dns/node-resolver-6x7pp","openshift-image-registry/node-ca-tbjmj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-28cz9","kube-system/global-pull-secret-syncer-mjbss","kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4","openshift-multus/multus-additional-cni-plugins-fl924","openshift-multus/multus-qfr64"] Jul 02 21:19:06.128880 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.128852 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.130662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.130639 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.133656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.131934 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 21:19:06.133656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.132100 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wrcpd\"" Jul 02 21:19:06.133656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.132256 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.133656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.132385 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.133857 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.133745 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.133949 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.133930 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 21:19:06.134066 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.134040 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rv7kb\"" Jul 02 21:19:06.134183 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.134074 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.134876 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.134856 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 21:19:06.134976 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.134912 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.135041 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.134974 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 21:19:06.135153 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.135133 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 21:19:06.135254 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.135234 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.137652 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.137507 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 21:19:06.137751 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.137725 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.137898 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.137879 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kj6rg\"" Jul 02 21:19:06.138165 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.138141 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.138510 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.138494 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.139030 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.138996 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 21:19:06.141148 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.139236 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 21:19:06.141148 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.139342 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wk2k\"" Jul 02 21:19:06.141148 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.140286 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.141336 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.141290 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.142033 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.142012 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.142121 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.142044 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hp9w7\"" Jul 02 21:19:06.142558 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.142532 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.143574 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143555 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.143670 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143627 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hq5bs\"" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143736 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143769 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hvw\" (UniqueName: \"kubernetes.io/projected/8361d1d0-806c-44aa-ae93-d407ef71ed9c-kube-api-access-r5hvw\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143799 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f9eddaf-0240-4089-b8bc-f52721de7a56-host\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143825 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llrbz\" (UniqueName: \"kubernetes.io/projected/7f9eddaf-0240-4089-b8bc-f52721de7a56-kube-api-access-llrbz\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143828 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143872 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-os-release\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143905 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143924 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143942 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af685e79-0650-4c3d-86d4-6e58de7130af-agent-certs\") pod \"konnectivity-agent-mt8fl\" (UID: \"af685e79-0650-4c3d-86d4-6e58de7130af\") " pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143966 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f9eddaf-0240-4089-b8bc-f52721de7a56-serviceca\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.143987 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6450f7dc-20f7-4e45-98d2-2136829714f7-iptables-alerter-script\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.144005 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bb75\" (UniqueName: \"kubernetes.io/projected/6450f7dc-20f7-4e45-98d2-2136829714f7-kube-api-access-6bb75\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.144020 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af685e79-0650-4c3d-86d4-6e58de7130af-konnectivity-ca\") pod \"konnectivity-agent-mt8fl\" (UID: \"af685e79-0650-4c3d-86d4-6e58de7130af\") " pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.144037 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cnibin\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.144053 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6450f7dc-20f7-4e45-98d2-2136829714f7-host-slash\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.144189 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.144087 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-system-cni-dir\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.144928 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.144114 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.145037 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145009 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.145137 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.145081 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:06.145244 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145228 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.145307 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145279 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 21:19:06.145679 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145653 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b4ctk\"" Jul 02 21:19:06.145778 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145710 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.145857 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145837 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 21:19:06.146005 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.145985 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 21:19:06.146570 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.146552 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:06.146702 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.146624 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:06.147046 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.147024 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 21:19:06.147284 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.147264 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:19:06.148346 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.148235 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.148346 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.148300 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:06.150962 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.150264 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.151614 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.151594 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.152782 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.152763 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 21:19:06.152879 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.152781 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cd42p\"" Jul 02 21:19:06.154519 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.154489 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 21:19:06.154616 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.154537 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 21:19:06.154676 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.154650 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4rhwg\"" Jul 02 21:19:06.155684 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.155663 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 21:19:06.169990 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.169928 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pf77p" Jul 02 21:19:06.176554 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.176529 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pf77p" Jul 02 21:19:06.234085 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.234060 2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 21:19:06.245418 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245385 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:06.245543 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245427 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cnibin\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.245543 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245448 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-var-lib-kubelet\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.245543 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245467 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-host\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.245543 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245488 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-kubelet\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.245543 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245489 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cnibin\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.245543 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245503 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-var-lib-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245565 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-node-log\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245612 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-cni-bin\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245640 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovnkube-script-lib\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245688 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-socket-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245726 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cw2h\" (UniqueName: \"kubernetes.io/projected/65e3dc4f-6305-400b-ace5-ed9a0e198369-kube-api-access-2cw2h\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245775 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/242246cb-b977-438a-8938-e1dc0cc58dcc-tmp-dir\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.245822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245815 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxkp\" (UniqueName: \"kubernetes.io/projected/5f94cd18-f3ca-4aa0-b466-c742e8de725a-kube-api-access-zjxkp\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245853 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-system-cni-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245878 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf80d24-1134-4f73-8de2-941f10b016c5-cni-binary-copy\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245904 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-cni-bin\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245930 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-kubelet\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.245982 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-conf-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246006 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/242246cb-b977-438a-8938-e1dc0cc58dcc-hosts-file\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246049 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-cni-netd\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246066 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-env-overrides\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246081 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysctl-d\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246096 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-sys\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246112 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbj2\" (UniqueName: \"kubernetes.io/projected/f319c121-9f17-4829-a2f8-d2825773ea94-kube-api-access-skbj2\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246141 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246129 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-sys-fs\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246174 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246200 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysctl-conf\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246228 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246252 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-cni-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246275 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-k8s-cni-cncf-io\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246301 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-hostroot\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246325 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-etc-kubernetes\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246349 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-etc-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246371 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-lib-modules\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246412 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-os-release\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246439 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246475 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af685e79-0650-4c3d-86d4-6e58de7130af-agent-certs\") pod \"konnectivity-agent-mt8fl\" (UID: \"af685e79-0650-4c3d-86d4-6e58de7130af\") " pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246500 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-systemd\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246523 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f319c121-9f17-4829-a2f8-d2825773ea94-tmp\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246543 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-cni-multus\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.246612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246559 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-daemon-config\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246669 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bb75\" (UniqueName: \"kubernetes.io/projected/6450f7dc-20f7-4e45-98d2-2136829714f7-kube-api-access-6bb75\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246706 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-kubelet-config\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246745 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-registration-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246772 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246797 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-run-netns\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246824 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovn-node-metrics-cert\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246851 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6450f7dc-20f7-4e45-98d2-2136829714f7-host-slash\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246877 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7s9\" (UniqueName: \"kubernetes.io/projected/242246cb-b977-438a-8938-e1dc0cc58dcc-kube-api-access-4s7s9\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246906 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-log-socket\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246932 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246954 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-netns\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.246981 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-multus-certs\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247007 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzll\" (UniqueName: \"kubernetes.io/projected/1cf80d24-1134-4f73-8de2-941f10b016c5-kube-api-access-wmzll\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247034 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f9eddaf-0240-4089-b8bc-f52721de7a56-host\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247106 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.247152 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247133 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f319c121-9f17-4829-a2f8-d2825773ea94-etc-tuned\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247161 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-dbus\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247187 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-run-ovn-kubernetes\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247204 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-run\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-cnibin\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247248 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-socket-dir-parent\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247275 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovnkube-config\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247291 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247313 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-system-cni-dir\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247329 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247347 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hvw\" (UniqueName: \"kubernetes.io/projected/8361d1d0-806c-44aa-ae93-d407ef71ed9c-kube-api-access-r5hvw\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247363 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-kubernetes\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247381 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-device-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247427 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-ovn\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247574 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llrbz\" (UniqueName: \"kubernetes.io/projected/7f9eddaf-0240-4089-b8bc-f52721de7a56-kube-api-access-llrbz\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247591 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysconfig\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.247707 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247607 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-os-release\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247635 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247653 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-systemd-units\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247670 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvf8k\" (UniqueName: \"kubernetes.io/projected/7d639562-6612-4749-aac9-93156846b5f3-kube-api-access-xvf8k\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247688 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f9eddaf-0240-4089-b8bc-f52721de7a56-serviceca\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247711 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6450f7dc-20f7-4e45-98d2-2136829714f7-iptables-alerter-script\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247729 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af685e79-0650-4c3d-86d4-6e58de7130af-konnectivity-ca\") pod \"konnectivity-agent-mt8fl\" (UID: \"af685e79-0650-4c3d-86d4-6e58de7130af\") " pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247761 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-modprobe-d\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247778 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-slash\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247795 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-systemd\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247813 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.248286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.247916 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-os-release\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.248668 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.248334 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.248668 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.248607 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 21:19:06.248918 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.248889 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f9eddaf-0240-4089-b8bc-f52721de7a56-host\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.249451 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.249169 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-system-cni-dir\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.249451 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.249295 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.249451 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.249343 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8361d1d0-806c-44aa-ae93-d407ef71ed9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.249451 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.249356 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6450f7dc-20f7-4e45-98d2-2136829714f7-host-slash\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.249809 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.249783 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f9eddaf-0240-4089-b8bc-f52721de7a56-serviceca\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.250625 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.250594 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6450f7dc-20f7-4e45-98d2-2136829714f7-iptables-alerter-script\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.250735 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.250709 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af685e79-0650-4c3d-86d4-6e58de7130af-konnectivity-ca\") pod \"konnectivity-agent-mt8fl\" (UID: \"af685e79-0650-4c3d-86d4-6e58de7130af\") " pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.250999 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.250981 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8361d1d0-806c-44aa-ae93-d407ef71ed9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.253099 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.252887 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af685e79-0650-4c3d-86d4-6e58de7130af-agent-certs\") pod \"konnectivity-agent-mt8fl\" (UID: \"af685e79-0650-4c3d-86d4-6e58de7130af\") " pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.260134 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.260107 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bb75\" (UniqueName: \"kubernetes.io/projected/6450f7dc-20f7-4e45-98d2-2136829714f7-kube-api-access-6bb75\") pod \"iptables-alerter-bbfk4\" (UID: \"6450f7dc-20f7-4e45-98d2-2136829714f7\") " pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.260245 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.260149 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hvw\" (UniqueName: \"kubernetes.io/projected/8361d1d0-806c-44aa-ae93-d407ef71ed9c-kube-api-access-r5hvw\") pod \"multus-additional-cni-plugins-fl924\" (UID: \"8361d1d0-806c-44aa-ae93-d407ef71ed9c\") " pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.261804 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.261780 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llrbz\" (UniqueName: \"kubernetes.io/projected/7f9eddaf-0240-4089-b8bc-f52721de7a56-kube-api-access-llrbz\") pod \"node-ca-tbjmj\" (UID: \"7f9eddaf-0240-4089-b8bc-f52721de7a56\") " pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.295134 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.295087 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" event={"ID":"b7c519ecbb7e86b3494895d9cd797fde","Type":"ContainerStarted","Data":"b655625f7293cc61b910750682b43a51037dbfd9b17a17d523abc6b0597933b6"} Jul 02 21:19:06.296518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.296480 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" event={"ID":"bc8b346ff26bd2da637db45021bfde3d","Type":"ContainerStarted","Data":"002780b768220ff5c4335854283e42aa984c7ce83b680206171fcd4f73bfa76f"} Jul 02 21:19:06.348209 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348171 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysctl-conf\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348216 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348241 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-cni-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348264 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-k8s-cni-cncf-io\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348288 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-hostroot\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348311 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-etc-kubernetes\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348350 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-etc-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348373 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-lib-modules\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348398 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-systemd\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.348428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348419 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f319c121-9f17-4829-a2f8-d2825773ea94-tmp\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348443 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-cni-multus\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348467 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-daemon-config\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348494 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-kubelet-config\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348521 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-registration-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348547 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348575 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-run-netns\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348600 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovn-node-metrics-cert\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348629 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7s9\" (UniqueName: \"kubernetes.io/projected/242246cb-b977-438a-8938-e1dc0cc58dcc-kube-api-access-4s7s9\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348654 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-log-socket\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348680 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-netns\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348705 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-multus-certs\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348734 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzll\" (UniqueName: \"kubernetes.io/projected/1cf80d24-1134-4f73-8de2-941f10b016c5-kube-api-access-wmzll\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348761 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f319c121-9f17-4829-a2f8-d2825773ea94-etc-tuned\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348786 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-dbus\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348812 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-run-ovn-kubernetes\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348836 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-run\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.348888 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348872 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-cnibin\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348897 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-socket-dir-parent\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348922 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovnkube-config\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348953 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.348988 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-kubernetes\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-device-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349114 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-device-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349253 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysctl-conf\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.349363 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349698 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-cni-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.349773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349757 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-k8s-cni-cncf-io\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.350227 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349803 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-hostroot\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.350227 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349848 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-etc-kubernetes\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.350227 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.349894 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-etc-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.350227 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350019 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-lib-modules\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.350227 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350076 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-systemd\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350501 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-ovn\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350545 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysconfig\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350569 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-os-release\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350585 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-multus-certs\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350666 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-ovn\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350669 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-run-netns\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350683 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350719 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysconfig\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350640 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-kubelet-config\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350587 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-cnibin\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350628 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350800 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-os-release\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350835 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-cni-multus\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350591 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350886 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-run-ovn-kubernetes\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.350989 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-run\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.351401 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.350636 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:06.850608811 +0000 UTC m=+3.151403222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351227 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-daemon-config\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351244 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-systemd-units\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351275 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvf8k\" (UniqueName: \"kubernetes.io/projected/7d639562-6612-4749-aac9-93156846b5f3-kube-api-access-xvf8k\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351278 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-log-socket\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351305 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-modprobe-d\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351316 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-systemd-units\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351329 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-slash\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351359 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-run-netns\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351357 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-systemd\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351410 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-systemd\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351417 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351447 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-dbus\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351473 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-var-lib-kubelet\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351519 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-var-lib-kubelet\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351534 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-host\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.352399 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351561 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351599 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-host\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351603 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-kubelet\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.351690 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351712 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-modprobe-d\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.351741 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:06.85172346 +0000 UTC m=+3.152517874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351564 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-kubelet\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351767 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-socket-dir-parent\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351776 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-var-lib-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351804 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-node-log\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351807 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-slash\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351828 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-cni-bin\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351854 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovnkube-script-lib\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351862 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-kubernetes\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351879 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-socket-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351905 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cw2h\" (UniqueName: \"kubernetes.io/projected/65e3dc4f-6305-400b-ace5-ed9a0e198369-kube-api-access-2cw2h\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351918 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-registration-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.353853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351935 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/242246cb-b977-438a-8938-e1dc0cc58dcc-tmp-dir\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351954 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-node-log\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351961 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxkp\" (UniqueName: \"kubernetes.io/projected/5f94cd18-f3ca-4aa0-b466-c742e8de725a-kube-api-access-zjxkp\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.351987 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-system-cni-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352015 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf80d24-1134-4f73-8de2-941f10b016c5-cni-binary-copy\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352042 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-cni-bin\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352079 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-kubelet\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352104 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-conf-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352130 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/242246cb-b977-438a-8938-e1dc0cc58dcc-hosts-file\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352155 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-cni-netd\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352168 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovnkube-config\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352180 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-env-overrides\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352203 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-var-lib-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352239 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-system-cni-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352264 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-socket-dir\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352307 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-cni-bin\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352346 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-host-var-lib-kubelet\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352409 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf80d24-1134-4f73-8de2-941f10b016c5-multus-conf-dir\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.354772 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/242246cb-b977-438a-8938-e1dc0cc58dcc-hosts-file\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352498 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-cni-netd\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352540 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/242246cb-b977-438a-8938-e1dc0cc58dcc-tmp-dir\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352723 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysctl-d\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352754 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-sys\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352761 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovnkube-script-lib\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352783 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skbj2\" (UniqueName: \"kubernetes.io/projected/f319c121-9f17-4829-a2f8-d2825773ea94-kube-api-access-skbj2\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352813 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-sys-fs\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352839 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352895 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f94cd18-f3ca-4aa0-b466-c742e8de725a-env-overrides\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352907 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-run-openvswitch\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352907 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-etc-sysctl-d\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352963 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f319c121-9f17-4829-a2f8-d2825773ea94-sys\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.352973 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65e3dc4f-6305-400b-ace5-ed9a0e198369-sys-fs\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.353008 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f94cd18-f3ca-4aa0-b466-c742e8de725a-host-cni-bin\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.353382 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f319c121-9f17-4829-a2f8-d2825773ea94-tmp\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.353470 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf80d24-1134-4f73-8de2-941f10b016c5-cni-binary-copy\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.353841 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f319c121-9f17-4829-a2f8-d2825773ea94-etc-tuned\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.355669 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.354667 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f94cd18-f3ca-4aa0-b466-c742e8de725a-ovn-node-metrics-cert\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.356641 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.356039 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:19:06.360914 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.360886 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:06.360914 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.360916 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:06.361064 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.360930 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:06.361064 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.360989 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:19:06.860971346 +0000 UTC m=+3.161765771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:06.365850 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.365821 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cw2h\" (UniqueName: \"kubernetes.io/projected/65e3dc4f-6305-400b-ace5-ed9a0e198369-kube-api-access-2cw2h\") pod \"aws-ebs-csi-driver-node-b5pk4\" (UID: \"65e3dc4f-6305-400b-ace5-ed9a0e198369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.366176 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.366150 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzll\" (UniqueName: \"kubernetes.io/projected/1cf80d24-1134-4f73-8de2-941f10b016c5-kube-api-access-wmzll\") pod \"multus-qfr64\" (UID: \"1cf80d24-1134-4f73-8de2-941f10b016c5\") " pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.366176 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.366172 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvf8k\" (UniqueName: \"kubernetes.io/projected/7d639562-6612-4749-aac9-93156846b5f3-kube-api-access-xvf8k\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.366338 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.366244 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxkp\" (UniqueName: \"kubernetes.io/projected/5f94cd18-f3ca-4aa0-b466-c742e8de725a-kube-api-access-zjxkp\") pod \"ovnkube-node-28cz9\" (UID: \"5f94cd18-f3ca-4aa0-b466-c742e8de725a\") " pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.366338 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.366308 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7s9\" (UniqueName: \"kubernetes.io/projected/242246cb-b977-438a-8938-e1dc0cc58dcc-kube-api-access-4s7s9\") pod \"node-resolver-6x7pp\" (UID: \"242246cb-b977-438a-8938-e1dc0cc58dcc\") " pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.366499 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.366482 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbj2\" (UniqueName: \"kubernetes.io/projected/f319c121-9f17-4829-a2f8-d2825773ea94-kube-api-access-skbj2\") pod \"tuned-kckxl\" (UID: \"f319c121-9f17-4829-a2f8-d2825773ea94\") " pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.445380 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.445260 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tbjmj" Jul 02 21:19:06.454521 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.454499 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fl924" Jul 02 21:19:06.469500 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.469465 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bbfk4" Jul 02 21:19:06.478501 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.478477 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:06.486472 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.486451 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kckxl" Jul 02 21:19:06.494352 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.494333 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6x7pp" Jul 02 21:19:06.504293 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.504272 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:06.511354 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.511336 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qfr64" Jul 02 21:19:06.519167 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.519144 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" Jul 02 21:19:06.857224 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.857185 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:06.857424 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.857243 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:06.857424 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.857384 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:06.857523 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.857450 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:07.857435158 +0000 UTC m=+4.158229566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:06.857523 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.857384 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:06.857523 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.857511 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:07.857497671 +0000 UTC m=+4.158292083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:06.957864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:06.957828 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:06.958061 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.958013 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:06.958061 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.958039 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:06.958061 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.958050 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:06.958242 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:06.958106 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:19:07.958092416 +0000 UTC m=+4.258886829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:07.179335 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:07.179265 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:14:06 +0000 UTC" deadline="2027-12-28 07:28:28.014631704 +0000 UTC" Jul 02 21:19:07.179864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:07.179343 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13042h9m20.835293364s" Jul 02 21:19:07.290613 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:07.290583 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:07.290817 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.290718 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:07.375046 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:07.374890 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242246cb_b977_438a_8938_e1dc0cc58dcc.slice/crio-6388dd577ff73d82894ef721073a5614969a70e2cd57d7a7e68e2f84891401ff WatchSource:0}: Error finding container 6388dd577ff73d82894ef721073a5614969a70e2cd57d7a7e68e2f84891401ff: Status 404 returned error can't find the container with id 6388dd577ff73d82894ef721073a5614969a70e2cd57d7a7e68e2f84891401ff Jul 02 21:19:07.383032 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:07.382991 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6450f7dc_20f7_4e45_98d2_2136829714f7.slice/crio-7f609da1a662fe313368ff7f0c60857d8d4814373807df12b9a2a38abf5cf37e WatchSource:0}: Error finding container 7f609da1a662fe313368ff7f0c60857d8d4814373807df12b9a2a38abf5cf37e: Status 404 returned error can't find the container with id 7f609da1a662fe313368ff7f0c60857d8d4814373807df12b9a2a38abf5cf37e Jul 02 21:19:07.384126 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:07.384097 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf685e79_0650_4c3d_86d4_6e58de7130af.slice/crio-98307c0b1c341e28978ae55caea9a9363a2a950a97889c49a698b41512c45f5d WatchSource:0}: Error finding container 98307c0b1c341e28978ae55caea9a9363a2a950a97889c49a698b41512c45f5d: Status 404 returned error can't find the container with id 98307c0b1c341e28978ae55caea9a9363a2a950a97889c49a698b41512c45f5d Jul 02 21:19:07.384976 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:07.384942 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f94cd18_f3ca_4aa0_b466_c742e8de725a.slice/crio-f524fa8294d2e72c0619651dff91fa2ec4c2648412367fb9f2d309fcba4ddef8 WatchSource:0}: Error finding container f524fa8294d2e72c0619651dff91fa2ec4c2648412367fb9f2d309fcba4ddef8: Status 404 returned error can't find the container with id f524fa8294d2e72c0619651dff91fa2ec4c2648412367fb9f2d309fcba4ddef8 Jul 02 21:19:07.386684 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:07.386137 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf319c121_9f17_4829_a2f8_d2825773ea94.slice/crio-fe6027e5ee772e1009c1b698b36ce79ed0a3764bb83b63deea0bf463288adba1 WatchSource:0}: Error finding container fe6027e5ee772e1009c1b698b36ce79ed0a3764bb83b63deea0bf463288adba1: Status 404 returned error can't find the container with id fe6027e5ee772e1009c1b698b36ce79ed0a3764bb83b63deea0bf463288adba1 Jul 02 21:19:07.866413 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:07.866355 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:07.866605 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:07.866442 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:07.866674 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.866598 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:07.866674 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.866669 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:09.866649003 +0000 UTC m=+6.167443419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:07.866802 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.866598 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:07.866802 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.866725 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:09.86670995 +0000 UTC m=+6.167504358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:07.969542 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:07.967786 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:07.969542 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.967994 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:07.969542 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.968015 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:07.969542 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.968029 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:07.969542 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:07.968093 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:19:09.968073277 +0000 UTC m=+6.268867691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:08.188544 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.179743 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:14:06 +0000 UTC" deadline="2028-04-09 05:07:56.098006092 +0000 UTC" Jul 02 21:19:08.188544 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.179784 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15511h48m47.918227009s" Jul 02 21:19:08.292127 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.291471 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:08.292127 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:08.291654 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:08.292831 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.292451 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:08.292831 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:08.292787 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:08.320264 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.320151 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" event={"ID":"65e3dc4f-6305-400b-ace5-ed9a0e198369","Type":"ContainerStarted","Data":"5abbbe8b04d420f2f3514a7134e2aa35fdebd93c0d43c179f958fca2e40ed745"} Jul 02 21:19:08.324383 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.324304 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6x7pp" event={"ID":"242246cb-b977-438a-8938-e1dc0cc58dcc","Type":"ContainerStarted","Data":"6388dd577ff73d82894ef721073a5614969a70e2cd57d7a7e68e2f84891401ff"} Jul 02 21:19:08.327696 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.327666 2550 generic.go:356] "Generic (PLEG): container finished" podID="b7c519ecbb7e86b3494895d9cd797fde" containerID="ef574a0476c7adfe7f54121d9401a2dcb82b113e916929c6f5aff8ab8baf9987" exitCode=0 Jul 02 21:19:08.327813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.327753 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" event={"ID":"b7c519ecbb7e86b3494895d9cd797fde","Type":"ContainerDied","Data":"ef574a0476c7adfe7f54121d9401a2dcb82b113e916929c6f5aff8ab8baf9987"} Jul 02 21:19:08.339815 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.339780 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" event={"ID":"bc8b346ff26bd2da637db45021bfde3d","Type":"ContainerStarted","Data":"c6740a99cd2c4acfe100aab8287a69dc3d376a5dab23d5f4ab2140f2453e935d"} Jul 02 21:19:08.345463 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.345436 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qfr64" event={"ID":"1cf80d24-1134-4f73-8de2-941f10b016c5","Type":"ContainerStarted","Data":"4968e6955655a9ecd424158217313c7737d71ff5bd1e1641c08b432d8c6b56a8"} Jul 02 21:19:08.359886 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.359852 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerStarted","Data":"9428fb5b41a3cb48f8d4dd0c041ae87fe8b39d3f5e2389719cc2201487bdc1ec"} Jul 02 21:19:08.361665 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.361603 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" podStartSLOduration=2.361584073 podStartE2EDuration="2.361584073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:08.360709742 +0000 UTC m=+4.661504177" watchObservedRunningTime="2026-07-02 21:19:08.361584073 +0000 UTC m=+4.662378507" Jul 02 21:19:08.374781 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.374696 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mt8fl" event={"ID":"af685e79-0650-4c3d-86d4-6e58de7130af","Type":"ContainerStarted","Data":"98307c0b1c341e28978ae55caea9a9363a2a950a97889c49a698b41512c45f5d"} Jul 02 21:19:08.379176 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.379095 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tbjmj" event={"ID":"7f9eddaf-0240-4089-b8bc-f52721de7a56","Type":"ContainerStarted","Data":"d4f46039f3f0c0f59a9eead38c9dda4b2e99a1b76c7afdbec6573ecf12ffcc0f"} Jul 02 21:19:08.395887 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.395853 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kckxl" event={"ID":"f319c121-9f17-4829-a2f8-d2825773ea94","Type":"ContainerStarted","Data":"fe6027e5ee772e1009c1b698b36ce79ed0a3764bb83b63deea0bf463288adba1"} Jul 02 21:19:08.411885 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.411811 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"f524fa8294d2e72c0619651dff91fa2ec4c2648412367fb9f2d309fcba4ddef8"} Jul 02 21:19:08.439645 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:08.439603 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bbfk4" event={"ID":"6450f7dc-20f7-4e45-98d2-2136829714f7","Type":"ContainerStarted","Data":"7f609da1a662fe313368ff7f0c60857d8d4814373807df12b9a2a38abf5cf37e"} Jul 02 21:19:09.291626 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:09.291049 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:09.291626 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.291185 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:09.455174 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:09.455093 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" event={"ID":"b7c519ecbb7e86b3494895d9cd797fde","Type":"ContainerStarted","Data":"1f632a64fd830e18663fc49a506675b2eea1ce841a4b8be0e771bce401ad284b"} Jul 02 21:19:09.473518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:09.473454 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" podStartSLOduration=3.473429862 podStartE2EDuration="3.473429862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:09.472848727 +0000 UTC m=+5.773643161" watchObservedRunningTime="2026-07-02 21:19:09.473429862 +0000 UTC m=+5.774224292" Jul 02 21:19:09.885138 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:09.885091 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:09.885354 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:09.885196 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:09.885354 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.885332 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:09.885506 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.885417 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:13.885397821 +0000 UTC m=+10.186192235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:09.885867 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.885846 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:09.885953 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.885906 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:13.885888676 +0000 UTC m=+10.186683085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:09.985601 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:09.985554 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:09.985905 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.985804 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:09.985905 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.985831 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:09.985905 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.985845 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:09.985905 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:09.985907 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:19:13.985887717 +0000 UTC m=+10.286682127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:10.292496 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:10.292414 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:10.292966 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:10.292565 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:10.293158 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:10.293048 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:10.293234 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:10.293192 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:11.291511 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:11.291470 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:11.291716 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:11.291625 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:12.291529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:12.291490 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:12.292046 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:12.291630 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:12.292195 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:12.292109 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:12.292254 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:12.292226 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:13.291218 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:13.291171 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:13.291426 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:13.291313 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:13.921005 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:13.920969 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:13.921005 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:13.921020 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:13.921516 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:13.921122 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:13.921516 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:13.921174 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:21.921160085 +0000 UTC m=+18.221954495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:13.921516 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:13.921444 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:13.921516 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:13.921506 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:21.921491002 +0000 UTC m=+18.222285414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:14.022027 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:14.021986 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:14.022208 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:14.022171 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:14.022208 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:14.022188 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:14.022208 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:14.022201 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:14.022428 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:14.022256 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:19:22.022241234 +0000 UTC m=+18.323035643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:14.292271 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:14.292107 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:14.292271 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:14.292237 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:14.292524 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:14.292290 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:14.292524 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:14.292423 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:15.291267 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:15.291223 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:15.291711 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:15.291389 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:16.295401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:16.294632 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:16.295401 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:16.294745 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:16.295401 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:16.295234 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:16.295401 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:16.295353 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:17.291632 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:17.291153 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:17.291632 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:17.291288 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:18.290831 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:18.290791 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:18.291305 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:18.290791 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:18.291305 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:18.290953 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:18.291305 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:18.290985 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:19.291242 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:19.291204 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:19.291663 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:19.291373 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:20.294599 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:20.294283 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:20.294599 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:20.294413 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:20.294599 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:20.294440 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:20.294599 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:20.294561 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:21.291232 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:21.291204 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:21.291425 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:21.291358 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:21.983614 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:21.983582 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:21.984063 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:21.983627 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:21.984063 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:21.983763 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:21.984063 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:21.983773 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:21.984063 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:21.983813 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:37.983798207 +0000 UTC m=+34.284592613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:21.984063 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:21.983826 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:37.983819543 +0000 UTC m=+34.284613950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:22.084988 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:22.084957 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:22.085138 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:22.085121 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:22.085187 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:22.085147 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:22.085187 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:22.085161 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:22.085261 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:22.085204 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:19:38.085192736 +0000 UTC m=+34.385987143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:22.291119 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:22.291093 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:22.291252 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:22.291132 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:22.291252 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:22.291240 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:22.291385 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:22.291362 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:23.290439 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:23.290397 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:23.290884 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:23.290547 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:24.293438 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:24.293407 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:24.293867 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:24.293517 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:24.293867 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:24.293585 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:24.293867 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:24.293703 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:25.291153 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:25.291107 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:25.291471 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:25.291230 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:26.294576 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:26.294077 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:26.294576 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:26.294210 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:26.294576 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:26.294268 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:26.294576 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:26.294403 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:27.291447 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.291235 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:27.291645 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:27.291549 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:27.493847 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.493767 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mt8fl" event={"ID":"af685e79-0650-4c3d-86d4-6e58de7130af","Type":"ContainerStarted","Data":"abc1050c7b3907cbd1de3cca4518cfac0e90858845924bc308050752a9cbe56e"} Jul 02 21:19:27.495466 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.495433 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tbjmj" event={"ID":"7f9eddaf-0240-4089-b8bc-f52721de7a56","Type":"ContainerStarted","Data":"ad71f57d2adfd7090b2b3dc65a20ef43f5bae93b9b284bbc14c4f933336295a0"} Jul 02 21:19:27.496809 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.496781 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kckxl" event={"ID":"f319c121-9f17-4829-a2f8-d2825773ea94","Type":"ContainerStarted","Data":"7f32f45c43f3d4d092de159fc9dbaf519bc1fe1c3fafe8feb6f368282e9370f4"} Jul 02 21:19:27.498251 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.498231 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" event={"ID":"65e3dc4f-6305-400b-ace5-ed9a0e198369","Type":"ContainerStarted","Data":"36973622f890e742901b8eac49db13bc982bdc0c81a4881fd0960f68c9ef8172"} Jul 02 21:19:27.499848 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.499823 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6x7pp" event={"ID":"242246cb-b977-438a-8938-e1dc0cc58dcc","Type":"ContainerStarted","Data":"ae36fc69b8914f60c03cc8ec514d89dbf185b3cc06a4c93bc922775a279474d6"} Jul 02 21:19:27.501337 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.501297 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qfr64" event={"ID":"1cf80d24-1134-4f73-8de2-941f10b016c5","Type":"ContainerStarted","Data":"b7968486cfb543d3e62eb2b02f5c5a60b91ee1458b15bbce328e3271c7bd0027"} Jul 02 21:19:27.502838 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.502806 2550 generic.go:356] "Generic (PLEG): container finished" podID="8361d1d0-806c-44aa-ae93-d407ef71ed9c" containerID="b4890f71dcd93aed52b491dc987c8c796d45d1132aec1578f8cc3dcaa590b488" exitCode=0 Jul 02 21:19:27.502912 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.502845 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerDied","Data":"b4890f71dcd93aed52b491dc987c8c796d45d1132aec1578f8cc3dcaa590b488"} Jul 02 21:19:27.533361 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.533288 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mt8fl" podStartSLOduration=3.314202349 podStartE2EDuration="22.533271762s" totalImagesPullingTime="19.219069413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:27.512971249 +0000 UTC m=+23.813765678" watchObservedRunningTime="2026-07-02 21:19:27.533271762 +0000 UTC m=+23.834066193" Jul 02 21:19:27.533518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.533392 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kckxl" podStartSLOduration=3.317357486 podStartE2EDuration="22.533387108s" totalImagesPullingTime="19.216029622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:27.532934941 +0000 UTC m=+23.833729383" watchObservedRunningTime="2026-07-02 21:19:27.533387108 +0000 UTC m=+23.834181537" Jul 02 21:19:27.557607 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.557548 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tbjmj" podStartSLOduration=3.34308266 podStartE2EDuration="22.557526246s" totalImagesPullingTime="19.214443586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:27.557251297 +0000 UTC m=+23.858045727" watchObservedRunningTime="2026-07-02 21:19:27.557526246 +0000 UTC m=+23.858320677" Jul 02 21:19:27.601286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.601221 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6x7pp" podStartSLOduration=3.356501384 podStartE2EDuration="22.601199783s" totalImagesPullingTime="19.244698399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:27.600809433 +0000 UTC m=+23.901603864" watchObservedRunningTime="2026-07-02 21:19:27.601199783 +0000 UTC m=+23.901994213" Jul 02 21:19:27.624461 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:27.623304 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qfr64" podStartSLOduration=3.382351207 podStartE2EDuration="22.623284648s" totalImagesPullingTime="19.240933441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:27.622401537 +0000 UTC m=+23.923195967" watchObservedRunningTime="2026-07-02 21:19:27.623284648 +0000 UTC m=+23.924079080" Jul 02 21:19:28.197509 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.197293 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 21:19:28.197973 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.197674 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:19:28.197505372Z","UUID":"ad861cd5-fa85-43fd-8260-5d4fb704e597","Handler":null,"Name":"","Endpoint":""} Jul 02 21:19:28.200074 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.199108 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 21:19:28.200074 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.199149 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 21:19:28.294329 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.294293 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:28.294511 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:28.294427 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:28.294568 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.294506 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:28.294695 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:28.294677 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:28.508951 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.508878 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:19:28.509446 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509370 2550 generic.go:356] "Generic (PLEG): container finished" podID="5f94cd18-f3ca-4aa0-b466-c742e8de725a" containerID="3d68a34ed7edc1f8ba147c5e0d3a89244d854a90689c7db3eaa2a50af1527d48" exitCode=1 Jul 02 21:19:28.509446 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509408 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"be9e35436bb63aece72c3b29060d7cbb263b6a0ba9183ceee6c91639f2148a0c"} Jul 02 21:19:28.509562 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509501 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"dd3dd28b3b31b9f480864e801ab9e9014e70b4c3d280f0cbc0be64c30209648c"} Jul 02 21:19:28.509562 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509554 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"4254ee40bd03e4bced5ee26a0d3f8c445ecae66b7eebfecbd88d8e6100eddbfb"} Jul 02 21:19:28.509662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509606 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"cbf643b7960a2df3e44f74189c0d99d5b20c2bde313b615bb8a71e4faf4e3bb1"} Jul 02 21:19:28.509662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509657 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerDied","Data":"3d68a34ed7edc1f8ba147c5e0d3a89244d854a90689c7db3eaa2a50af1527d48"} Jul 02 21:19:28.509764 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.509710 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"d90b66f1fc01a3d35e6824a2702d3338bc651065e4a564533bb9ff7389b468c5"} Jul 02 21:19:28.511236 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.511215 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bbfk4" event={"ID":"6450f7dc-20f7-4e45-98d2-2136829714f7","Type":"ContainerStarted","Data":"e1a263e74a030341ac7cc0f6eef2c96560a0b5f541008ba571bbfd6ca01b3760"} Jul 02 21:19:28.514134 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.514096 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" event={"ID":"65e3dc4f-6305-400b-ace5-ed9a0e198369","Type":"ContainerStarted","Data":"11ecb39320fe39beb30fc91df8292d1a60fc95b19ada536a17fbc14ab0bb6764"} Jul 02 21:19:28.563046 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.562957 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:28.563698 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.563678 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:28.582900 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:28.582843 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bbfk4" podStartSLOduration=4.341795629 podStartE2EDuration="23.582820811s" totalImagesPullingTime="19.241025182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:28.533392221 +0000 UTC m=+24.834186651" watchObservedRunningTime="2026-07-02 21:19:28.582820811 +0000 UTC m=+24.883615267" Jul 02 21:19:29.290630 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:29.290421 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:29.290771 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:29.290723 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:29.518813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:29.518727 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" event={"ID":"65e3dc4f-6305-400b-ace5-ed9a0e198369","Type":"ContainerStarted","Data":"bc39a5ba77e107d353ee8844a84ddb9ace72d4b0d049216599179d10745c10b4"} Jul 02 21:19:29.519488 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:29.519423 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:29.520566 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:29.520546 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mt8fl" Jul 02 21:19:29.540395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:29.540337 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5pk4" podStartSLOduration=3.199641855 podStartE2EDuration="24.540298646s" totalImagesPullingTime="21.340656791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:29.539904758 +0000 UTC m=+25.840699199" watchObservedRunningTime="2026-07-02 21:19:29.540298646 +0000 UTC m=+25.841093076" Jul 02 21:19:30.290920 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:30.290889 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:30.291115 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:30.290944 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:30.291115 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:30.291031 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:30.291234 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:30.291129 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:31.290754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:31.290714 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:31.291362 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:31.290836 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:32.291267 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:32.291169 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:32.291977 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:32.291175 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:32.291977 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:32.291353 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:32.291977 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:32.291396 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:32.526896 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:32.526864 2550 generic.go:356] "Generic (PLEG): container finished" podID="8361d1d0-806c-44aa-ae93-d407ef71ed9c" containerID="5f405ee748e7a665d37336e6627d54b34849dadcac3df91567718b8730ce85fb" exitCode=0 Jul 02 21:19:32.527081 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:32.526942 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerDied","Data":"5f405ee748e7a665d37336e6627d54b34849dadcac3df91567718b8730ce85fb"} Jul 02 21:19:32.530017 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:32.529999 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:19:32.530366 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:32.530348 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"8652828d3d3f5bca52a494fd4b7bf5fe1a9c19e461d52bc31143c4ca25041253"} Jul 02 21:19:33.291138 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:33.291110 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:33.291271 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:33.291228 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:33.534540 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:33.534458 2550 generic.go:356] "Generic (PLEG): container finished" podID="8361d1d0-806c-44aa-ae93-d407ef71ed9c" containerID="09db0c1e9d1aad97a3018417214906cea5f192aefaddcee2838698a0ee126ed3" exitCode=0 Jul 02 21:19:33.534540 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:33.534511 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerDied","Data":"09db0c1e9d1aad97a3018417214906cea5f192aefaddcee2838698a0ee126ed3"} Jul 02 21:19:34.293713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.292427 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:34.293713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.292494 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:34.293713 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:34.293104 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:34.295250 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:34.294256 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:34.539105 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.539020 2550 generic.go:356] "Generic (PLEG): container finished" podID="8361d1d0-806c-44aa-ae93-d407ef71ed9c" containerID="615d7c51f0723e6da2e353b54011f786a2ce5c59dacb282c2a34e2a6d0205e82" exitCode=0 Jul 02 21:19:34.539564 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.539097 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerDied","Data":"615d7c51f0723e6da2e353b54011f786a2ce5c59dacb282c2a34e2a6d0205e82"} Jul 02 21:19:34.542737 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.542719 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:19:34.543073 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.543051 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"6c42b5a2b6c7bb88d82cb948b2d2c36b6cd44ab5c819af27f4414ae8c40a4e4c"} Jul 02 21:19:34.543324 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.543296 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:34.543511 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.543495 2550 scope.go:117] "RemoveContainer" containerID="3d68a34ed7edc1f8ba147c5e0d3a89244d854a90689c7db3eaa2a50af1527d48" Jul 02 21:19:34.559994 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:34.559972 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:35.290999 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.290827 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:35.291191 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:35.291081 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:35.549507 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.549422 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:35.549925 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.549763 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:19:35.550208 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.550182 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" event={"ID":"5f94cd18-f3ca-4aa0-b466-c742e8de725a","Type":"ContainerStarted","Data":"3b090deaa23940918210dfe848d835c1917683810479c035ded294001298b8f1"} Jul 02 21:19:35.550454 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.550422 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:35.568749 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.568722 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:19:35.602354 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.600924 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" podStartSLOduration=10.275732674 podStartE2EDuration="30.600906082s" totalImagesPullingTime="20.325173408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:35.600201494 +0000 UTC m=+31.900995923" watchObservedRunningTime="2026-07-02 21:19:35.600906082 +0000 UTC m=+31.901700510" Jul 02 21:19:35.893022 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.892990 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsb68"] Jul 02 21:19:35.893176 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.893135 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:35.893250 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:35.893220 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:35.896590 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.896557 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mjbss"] Jul 02 21:19:35.896739 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.896687 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:35.896814 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:35.896789 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:35.897024 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.896992 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vkrs"] Jul 02 21:19:35.897126 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:35.897108 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:35.897233 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:35.897212 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:37.290580 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:37.290535 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:37.290580 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:37.290582 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:37.291210 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:37.290587 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:37.291210 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:37.290662 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:37.291210 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:37.290777 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:37.291210 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:37.290841 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:38.003240 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:38.003202 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:38.003435 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:38.003265 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:38.003435 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.003412 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:38.003435 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.003415 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:38.003583 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.003482 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs podName:7d639562-6612-4749-aac9-93156846b5f3 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.003464579 +0000 UTC m=+66.304259001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs") pod "network-metrics-daemon-4vkrs" (UID: "7d639562-6612-4749-aac9-93156846b5f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:38.003583 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.003504 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret podName:e34ed7b7-7ec0-465a-b36e-b5520d643fc4 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.003492688 +0000 UTC m=+66.304287109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret") pod "global-pull-secret-syncer-mjbss" (UID: "e34ed7b7-7ec0-465a-b36e-b5520d643fc4") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:38.104652 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:38.104562 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:38.104800 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.104719 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:38.104800 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.104742 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:38.104800 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.104756 2550 projected.go:196] Error preparing data for projected volume kube-api-access-gzlqf for pod openshift-network-diagnostics/network-check-target-jsb68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:38.104925 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:38.104806 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf podName:fe001302-d790-4a79-b07f-63ff03496eda nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.104793845 +0000 UTC m=+66.405588252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzlqf" (UniqueName: "kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf") pod "network-check-target-jsb68" (UID: "fe001302-d790-4a79-b07f-63ff03496eda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:39.290573 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.290491 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:39.290573 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.290513 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:39.290573 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.290513 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:39.291056 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:39.290592 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsb68" podUID="fe001302-d790-4a79-b07f-63ff03496eda" Jul 02 21:19:39.291056 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:39.290679 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vkrs" podUID="7d639562-6612-4749-aac9-93156846b5f3" Jul 02 21:19:39.291056 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:39.290756 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjbss" podUID="e34ed7b7-7ec0-465a-b36e-b5520d643fc4" Jul 02 21:19:39.455877 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.455849 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeReady" Jul 02 21:19:39.456070 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.455995 2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 21:19:39.510147 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.510112 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4vxcx"] Jul 02 21:19:39.528368 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.528333 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-srm2w"] Jul 02 21:19:39.528506 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.528442 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.531521 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.531424 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sklqf\"" Jul 02 21:19:39.531521 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.531444 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 21:19:39.531521 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.531424 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 21:19:39.550413 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.550350 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vxcx"] Jul 02 21:19:39.550413 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.550389 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-srm2w"] Jul 02 21:19:39.550545 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.550452 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.553283 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.553263 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 21:19:39.553538 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.553515 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7htl\"" Jul 02 21:19:39.553538 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.553533 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 21:19:39.553787 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.553773 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 21:19:39.563170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.563148 2550 generic.go:356] "Generic (PLEG): container finished" podID="8361d1d0-806c-44aa-ae93-d407ef71ed9c" containerID="c339954e2fcc9e2f18e170a430f3856f9bc06193f693a76f48644ccff78e5c37" exitCode=0 Jul 02 21:19:39.563254 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.563203 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerDied","Data":"c339954e2fcc9e2f18e170a430f3856f9bc06193f693a76f48644ccff78e5c37"} Jul 02 21:19:39.618597 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.618567 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-config-volume\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.618597 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.618598 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.618836 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.618648 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-tmp-dir\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.618836 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.618692 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7chh\" (UniqueName: \"kubernetes.io/projected/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-kube-api-access-p7chh\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.719178 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.718957 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dabb5f36-2206-455f-a785-d48f69bfef9f-cert\") pod \"ingress-canary-srm2w\" (UID: \"dabb5f36-2206-455f-a785-d48f69bfef9f\") " pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.719297 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719214 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-tmp-dir\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.719297 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719268 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgdfp\" (UniqueName: \"kubernetes.io/projected/dabb5f36-2206-455f-a785-d48f69bfef9f-kube-api-access-hgdfp\") pod \"ingress-canary-srm2w\" (UID: \"dabb5f36-2206-455f-a785-d48f69bfef9f\") " pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.719439 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719398 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7chh\" (UniqueName: \"kubernetes.io/projected/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-kube-api-access-p7chh\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.719523 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719507 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-config-volume\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.719576 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719537 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.719576 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719555 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-tmp-dir\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.719689 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:39.719654 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:39.719748 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:39.719732 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls podName:0bcdcc4c-fc8d-47a8-9465-c6e331b54766 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:40.219711908 +0000 UTC m=+36.520506317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls") pod "dns-default-4vxcx" (UID: "0bcdcc4c-fc8d-47a8-9465-c6e331b54766") : secret "dns-default-metrics-tls" not found Jul 02 21:19:39.720198 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.719926 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-config-volume\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.730608 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.730586 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7chh\" (UniqueName: \"kubernetes.io/projected/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-kube-api-access-p7chh\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:39.820352 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.820323 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgdfp\" (UniqueName: \"kubernetes.io/projected/dabb5f36-2206-455f-a785-d48f69bfef9f-kube-api-access-hgdfp\") pod \"ingress-canary-srm2w\" (UID: \"dabb5f36-2206-455f-a785-d48f69bfef9f\") " pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.820514 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.820501 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dabb5f36-2206-455f-a785-d48f69bfef9f-cert\") pod \"ingress-canary-srm2w\" (UID: \"dabb5f36-2206-455f-a785-d48f69bfef9f\") " pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.823064 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.823044 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dabb5f36-2206-455f-a785-d48f69bfef9f-cert\") pod \"ingress-canary-srm2w\" (UID: \"dabb5f36-2206-455f-a785-d48f69bfef9f\") " pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.829683 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.829661 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgdfp\" (UniqueName: \"kubernetes.io/projected/dabb5f36-2206-455f-a785-d48f69bfef9f-kube-api-access-hgdfp\") pod \"ingress-canary-srm2w\" (UID: \"dabb5f36-2206-455f-a785-d48f69bfef9f\") " pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:39.858613 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:39.858585 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-srm2w" Jul 02 21:19:40.104975 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:40.104900 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-srm2w"] Jul 02 21:19:40.108396 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:40.108361 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabb5f36_2206_455f_a785_d48f69bfef9f.slice/crio-43120878c9fe44d4aa66eb37e3e32927715d39ec44fec053de963ec313c84191 WatchSource:0}: Error finding container 43120878c9fe44d4aa66eb37e3e32927715d39ec44fec053de963ec313c84191: Status 404 returned error can't find the container with id 43120878c9fe44d4aa66eb37e3e32927715d39ec44fec053de963ec313c84191 Jul 02 21:19:40.223551 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:40.223508 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:40.223710 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:40.223660 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:40.223750 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:40.223741 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls podName:0bcdcc4c-fc8d-47a8-9465-c6e331b54766 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:41.223725449 +0000 UTC m=+37.524519857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls") pod "dns-default-4vxcx" (UID: "0bcdcc4c-fc8d-47a8-9465-c6e331b54766") : secret "dns-default-metrics-tls" not found Jul 02 21:19:40.568709 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:40.568677 2550 generic.go:356] "Generic (PLEG): container finished" podID="8361d1d0-806c-44aa-ae93-d407ef71ed9c" containerID="2c4d9c0e2b5638e28d0c2ddfc4f54cc4a1a76cef14def31dd40b75076e5e0f22" exitCode=0 Jul 02 21:19:40.569163 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:40.568759 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerDied","Data":"2c4d9c0e2b5638e28d0c2ddfc4f54cc4a1a76cef14def31dd40b75076e5e0f22"} Jul 02 21:19:40.569946 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:40.569919 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-srm2w" event={"ID":"dabb5f36-2206-455f-a785-d48f69bfef9f","Type":"ContainerStarted","Data":"43120878c9fe44d4aa66eb37e3e32927715d39ec44fec053de963ec313c84191"} Jul 02 21:19:41.231550 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.231366 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:41.231550 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:41.231533 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:41.231849 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:41.231616 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls podName:0bcdcc4c-fc8d-47a8-9465-c6e331b54766 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:43.231599446 +0000 UTC m=+39.532393858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls") pod "dns-default-4vxcx" (UID: "0bcdcc4c-fc8d-47a8-9465-c6e331b54766") : secret "dns-default-metrics-tls" not found Jul 02 21:19:41.291027 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.290988 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:19:41.291027 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.291021 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:19:41.291257 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.291021 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:19:41.294762 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.294738 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:19:41.294903 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.294769 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6k252\"" Jul 02 21:19:41.295846 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.295830 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:19:41.296080 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.296065 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:19:41.296184 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.296108 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bjnbk\"" Jul 02 21:19:41.296184 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.296145 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:19:41.575044 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.575012 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl924" event={"ID":"8361d1d0-806c-44aa-ae93-d407ef71ed9c","Type":"ContainerStarted","Data":"a701134a5655a5983a238c70365fea14f9a6a6a09f8c5d0411b9e0eabb101e92"} Jul 02 21:19:41.604494 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:41.604437 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fl924" podStartSLOduration=7.195203891 podStartE2EDuration="36.604418403s" totalImagesPullingTime="29.409214512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:41.602240049 +0000 UTC m=+37.903034480" watchObservedRunningTime="2026-07-02 21:19:41.604418403 +0000 UTC m=+37.905212832" Jul 02 21:19:43.245989 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:43.245952 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:43.246490 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:43.246107 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:43.246490 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:43.246171 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls podName:0bcdcc4c-fc8d-47a8-9465-c6e331b54766 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:47.24615571 +0000 UTC m=+43.546950120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls") pod "dns-default-4vxcx" (UID: "0bcdcc4c-fc8d-47a8-9465-c6e331b54766") : secret "dns-default-metrics-tls" not found Jul 02 21:19:43.581581 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:43.581543 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-srm2w" event={"ID":"dabb5f36-2206-455f-a785-d48f69bfef9f","Type":"ContainerStarted","Data":"7e51d20d0d4e0e940a21e2cc7d5458da1b9971b329eca3606725aeacacfdd165"} Jul 02 21:19:43.599813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:43.599758 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-srm2w" podStartSLOduration=2.191320558 podStartE2EDuration="4.599741338s" totalImagesPullingTime="2.40842078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:43.599156288 +0000 UTC m=+39.899950716" watchObservedRunningTime="2026-07-02 21:19:43.599741338 +0000 UTC m=+39.900535766" Jul 02 21:19:47.272942 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:47.272900 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:47.273493 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:47.273066 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:47.273493 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:47.273142 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls podName:0bcdcc4c-fc8d-47a8-9465-c6e331b54766 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:55.273125644 +0000 UTC m=+51.573920062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls") pod "dns-default-4vxcx" (UID: "0bcdcc4c-fc8d-47a8-9465-c6e331b54766") : secret "dns-default-metrics-tls" not found Jul 02 21:19:50.349188 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.349152 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-5qf9s"] Jul 02 21:19:50.395612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.395574 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-5qf9s"] Jul 02 21:19:50.395775 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.395689 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.398546 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.398521 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 21:19:50.398728 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.398712 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vg6nz\"" Jul 02 21:19:50.398794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.398714 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 21:19:50.398794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.398787 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 21:19:50.400037 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.400021 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 21:19:50.405091 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.405074 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 21:19:50.478624 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.478593 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69c64548d9-5wp72"] Jul 02 21:19:50.497210 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.497187 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbknt\" (UniqueName: \"kubernetes.io/projected/818db894-96da-498c-8245-f8dd288601cc-kube-api-access-sbknt\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.497347 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.497240 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/818db894-96da-498c-8245-f8dd288601cc-snapshots\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.497347 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.497258 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818db894-96da-498c-8245-f8dd288601cc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.497347 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.497298 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/818db894-96da-498c-8245-f8dd288601cc-serving-cert\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.497446 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.497355 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/818db894-96da-498c-8245-f8dd288601cc-tmp\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.497446 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.497390 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818db894-96da-498c-8245-f8dd288601cc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.498306 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.498285 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm"] Jul 02 21:19:50.498409 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.498400 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.503516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.503494 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 21:19:50.503745 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.503727 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-glqcf\"" Jul 02 21:19:50.503831 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.503731 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 21:19:50.505686 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.505671 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 21:19:50.506662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.506645 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 21:19:50.506800 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.506785 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 21:19:50.506800 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.506787 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 21:19:50.522713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.522684 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.528277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.528254 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 21:19:50.528277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.528269 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 21:19:50.529633 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.529615 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-89c4r\"" Jul 02 21:19:50.529723 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.529680 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 21:19:50.529773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.529755 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 21:19:50.540719 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.540692 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm"] Jul 02 21:19:50.541421 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.541402 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69c64548d9-5wp72"] Jul 02 21:19:50.597634 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597608 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-default-certificate\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.597833 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597679 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/818db894-96da-498c-8245-f8dd288601cc-snapshots\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.597833 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597733 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818db894-96da-498c-8245-f8dd288601cc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.597833 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597797 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/818db894-96da-498c-8245-f8dd288601cc-serving-cert\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.597833 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597819 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/818db894-96da-498c-8245-f8dd288601cc-tmp\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.598018 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597865 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-stats-auth\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.598018 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597903 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818db894-96da-498c-8245-f8dd288601cc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.598018 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597925 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.598018 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.597993 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbknt\" (UniqueName: \"kubernetes.io/projected/818db894-96da-498c-8245-f8dd288601cc-kube-api-access-sbknt\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.598018 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.598015 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.598243 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.598035 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snwcl\" (UniqueName: \"kubernetes.io/projected/9bf0a887-dedc-44ac-a3fb-ad6392975200-kube-api-access-snwcl\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.598306 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.598287 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/818db894-96da-498c-8245-f8dd288601cc-tmp\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.598458 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.598437 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/818db894-96da-498c-8245-f8dd288601cc-snapshots\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.598565 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.598550 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818db894-96da-498c-8245-f8dd288601cc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.598920 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.598901 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818db894-96da-498c-8245-f8dd288601cc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.601431 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.601387 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/818db894-96da-498c-8245-f8dd288601cc-serving-cert\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.611673 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.611648 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbknt\" (UniqueName: \"kubernetes.io/projected/818db894-96da-498c-8245-f8dd288601cc-kube-api-access-sbknt\") pod \"insights-operator-5c847dcfc4-5qf9s\" (UID: \"818db894-96da-498c-8245-f8dd288601cc\") " pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.667639 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.667605 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4"] Jul 02 21:19:50.699265 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699233 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-stats-auth\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.699265 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699268 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.699493 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699367 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.699493 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.699404 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:51.199390854 +0000 UTC m=+47.500185266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:50.699493 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699420 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snwcl\" (UniqueName: \"kubernetes.io/projected/9bf0a887-dedc-44ac-a3fb-ad6392975200-kube-api-access-snwcl\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.699493 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.699453 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:50.699493 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699450 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.699493 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.699495 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:51.199483444 +0000 UTC m=+47.500277853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : secret "router-metrics-certs-default" not found Jul 02 21:19:50.699756 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699554 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-default-certificate\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.699756 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699606 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.699756 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.699633 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtp5x\" (UniqueName: \"kubernetes.io/projected/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-kube-api-access-dtp5x\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.700811 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.700784 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4"] Jul 02 21:19:50.700931 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.700910 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:50.701925 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.701901 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-stats-auth\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.702146 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.702128 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-default-certificate\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.703299 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.703279 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 21:19:50.703482 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.703464 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dp5kg\"" Jul 02 21:19:50.703482 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.703476 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:50.703745 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.703732 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:50.705437 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.705425 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" Jul 02 21:19:50.719172 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.719148 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snwcl\" (UniqueName: \"kubernetes.io/projected/9bf0a887-dedc-44ac-a3fb-ad6392975200-kube-api-access-snwcl\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:50.800658 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.800535 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.800658 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.800580 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bs2\" (UniqueName: \"kubernetes.io/projected/9f7879bb-888b-4855-ba42-c13be0e73b97-kube-api-access-p4bs2\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:50.800658 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.800638 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.800929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.800670 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtp5x\" (UniqueName: \"kubernetes.io/projected/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-kube-api-access-dtp5x\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.800929 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.800686 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:50.800929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.800698 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:50.800929 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.800751 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls podName:6d3755ce-b5be-409a-ba9d-7e96dd99c5bb nodeName:}" failed. No retries permitted until 2026-07-02 21:19:51.30073269 +0000 UTC m=+47.601527111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkfm" (UID: "6d3755ce-b5be-409a-ba9d-7e96dd99c5bb") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:50.801781 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.801751 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.817412 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.817385 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtp5x\" (UniqueName: \"kubernetes.io/projected/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-kube-api-access-dtp5x\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:50.853124 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.853044 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-5qf9s"] Jul 02 21:19:50.855604 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:19:50.855577 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818db894_96da_498c_8245_f8dd288601cc.slice/crio-9074d09543a7d46aa264005623aa28c9f5a1d6f5423cc5313c5de5d60b56707a WatchSource:0}: Error finding container 9074d09543a7d46aa264005623aa28c9f5a1d6f5423cc5313c5de5d60b56707a: Status 404 returned error can't find the container with id 9074d09543a7d46aa264005623aa28c9f5a1d6f5423cc5313c5de5d60b56707a Jul 02 21:19:50.901689 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.901653 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bs2\" (UniqueName: \"kubernetes.io/projected/9f7879bb-888b-4855-ba42-c13be0e73b97-kube-api-access-p4bs2\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:50.901832 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.901712 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:50.901832 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.901802 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:50.901937 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:50.901857 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls podName:9f7879bb-888b-4855-ba42-c13be0e73b97 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:51.401842764 +0000 UTC m=+47.702637172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9m5x4" (UID: "9f7879bb-888b-4855-ba42-c13be0e73b97") : secret "samples-operator-tls" not found Jul 02 21:19:50.912158 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:50.912124 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bs2\" (UniqueName: \"kubernetes.io/projected/9f7879bb-888b-4855-ba42-c13be0e73b97-kube-api-access-p4bs2\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:51.204339 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:51.204233 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:51.204339 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:51.204282 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:51.204513 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.204395 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:51.204513 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.204447 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:52.204428989 +0000 UTC m=+48.505223400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:51.204513 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.204473 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:52.204464905 +0000 UTC m=+48.505259312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : secret "router-metrics-certs-default" not found Jul 02 21:19:51.305415 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:51.305379 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:51.305539 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.305509 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:51.305580 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.305565 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls podName:6d3755ce-b5be-409a-ba9d-7e96dd99c5bb nodeName:}" failed. No retries permitted until 2026-07-02 21:19:52.305549803 +0000 UTC m=+48.606344210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkfm" (UID: "6d3755ce-b5be-409a-ba9d-7e96dd99c5bb") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:51.406277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:51.406229 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:51.406747 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.406416 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:51.406747 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:51.406497 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls podName:9f7879bb-888b-4855-ba42-c13be0e73b97 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:52.406476268 +0000 UTC m=+48.707270691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9m5x4" (UID: "9f7879bb-888b-4855-ba42-c13be0e73b97") : secret "samples-operator-tls" not found Jul 02 21:19:51.602370 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:51.602335 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" event={"ID":"818db894-96da-498c-8245-f8dd288601cc","Type":"ContainerStarted","Data":"9074d09543a7d46aa264005623aa28c9f5a1d6f5423cc5313c5de5d60b56707a"} Jul 02 21:19:52.213967 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:52.213931 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:52.214176 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:52.213985 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:52.214176 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.214072 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:52.214176 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.214115 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:54.214101206 +0000 UTC m=+50.514895613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : secret "router-metrics-certs-default" not found Jul 02 21:19:52.214176 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.214133 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:54.214127868 +0000 UTC m=+50.514922274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:52.315155 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:52.315114 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:52.315362 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.315277 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:52.315421 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.315375 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls podName:6d3755ce-b5be-409a-ba9d-7e96dd99c5bb nodeName:}" failed. No retries permitted until 2026-07-02 21:19:54.315357899 +0000 UTC m=+50.616152310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkfm" (UID: "6d3755ce-b5be-409a-ba9d-7e96dd99c5bb") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:52.416450 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:52.416412 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:52.416901 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.416533 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:52.416901 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:52.416594 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls podName:9f7879bb-888b-4855-ba42-c13be0e73b97 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:54.416581506 +0000 UTC m=+50.717375914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9m5x4" (UID: "9f7879bb-888b-4855-ba42-c13be0e73b97") : secret "samples-operator-tls" not found Jul 02 21:19:53.608593 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:53.608558 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" event={"ID":"818db894-96da-498c-8245-f8dd288601cc","Type":"ContainerStarted","Data":"03fbd35ba5ad3e0e969bfbdac7831895d0898a07e01083ef1864afd645876d5a"} Jul 02 21:19:53.629004 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:53.628953 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" podStartSLOduration=1.409474012 podStartE2EDuration="3.628938033s" totalImagesPullingTime="2.219464021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:53.627579349 +0000 UTC m=+49.928373777" watchObservedRunningTime="2026-07-02 21:19:53.628938033 +0000 UTC m=+49.929732461" Jul 02 21:19:54.231038 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.230995 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:54.231038 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.231047 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:54.231237 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.231157 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.231138667 +0000 UTC m=+54.531933077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:54.231237 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.231193 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:54.231237 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.231232 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.231221173 +0000 UTC m=+54.532015580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : secret "router-metrics-certs-default" not found Jul 02 21:19:54.331664 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.331628 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:54.331803 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.331765 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:54.331861 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.331831 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls podName:6d3755ce-b5be-409a-ba9d-7e96dd99c5bb nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.331816441 +0000 UTC m=+54.632610848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkfm" (UID: "6d3755ce-b5be-409a-ba9d-7e96dd99c5bb") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:54.432788 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.432743 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:54.432947 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.432903 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:54.433000 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.432986 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls podName:9f7879bb-888b-4855-ba42-c13be0e73b97 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.432966453 +0000 UTC m=+54.733760871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9m5x4" (UID: "9f7879bb-888b-4855-ba42-c13be0e73b97") : secret "samples-operator-tls" not found Jul 02 21:19:54.651280 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.651248 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fkt9s"] Jul 02 21:19:54.673519 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.673492 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.678957 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.678933 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fkt9s"] Jul 02 21:19:54.682084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.680910 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zd4gb\"" Jul 02 21:19:54.682084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.681027 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 21:19:54.682084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.681297 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 21:19:54.735204 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.735171 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.735396 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.735236 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5c05b14-d8e4-4781-9568-9f75605aeec7-crio-socket\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.735396 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.735291 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5c05b14-d8e4-4781-9568-9f75605aeec7-data-volume\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.735396 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.735343 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.735528 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.735407 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5v9\" (UniqueName: \"kubernetes.io/projected/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-api-access-4z5v9\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.835898 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.835859 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5c05b14-d8e4-4781-9568-9f75605aeec7-crio-socket\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.835898 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.835897 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5c05b14-d8e4-4781-9568-9f75605aeec7-data-volume\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.836144 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.835915 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.836144 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.836042 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:54.836144 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.836057 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5v9\" (UniqueName: \"kubernetes.io/projected/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-api-access-4z5v9\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.836144 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.836111 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:55.336090199 +0000 UTC m=+51.636884621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:54.836144 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.836111 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5c05b14-d8e4-4781-9568-9f75605aeec7-crio-socket\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.836419 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.836221 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.836419 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.836284 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5c05b14-d8e4-4781-9568-9f75605aeec7-data-volume\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:54.836419 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.836391 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:54.836529 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:54.836437 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:55.336424034 +0000 UTC m=+51.637218444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : configmap "kube-rbac-proxy" not found Jul 02 21:19:54.845267 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:54.845245 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5v9\" (UniqueName: \"kubernetes.io/projected/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-api-access-4z5v9\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:55.340127 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:55.340088 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:55.340145 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:55.340198 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:55.340230 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:55.340288 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls podName:0bcdcc4c-fc8d-47a8-9465-c6e331b54766 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:11.340273533 +0000 UTC m=+67.641067940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls") pod "dns-default-4vxcx" (UID: "0bcdcc4c-fc8d-47a8-9465-c6e331b54766") : secret "dns-default-metrics-tls" not found Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:55.340293 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:55.340335 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:55.340373 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:56.340361987 +0000 UTC m=+52.641156394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:55.340416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:55.340384 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:56.340378476 +0000 UTC m=+52.641172883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : configmap "kube-rbac-proxy" not found Jul 02 21:19:56.323843 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:56.323813 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6x7pp_242246cb-b977-438a-8938-e1dc0cc58dcc/dns-node-resolver/0.log" Jul 02 21:19:56.349475 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:56.349436 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:56.349644 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:56.349560 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:56.349644 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:56.349588 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:56.349756 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:56.349643 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:56.349756 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:56.349653 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.349637437 +0000 UTC m=+54.650431845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:56.349756 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:56.349696 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.349678954 +0000 UTC m=+54.650473379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : configmap "kube-rbac-proxy" not found Jul 02 21:19:57.717079 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:57.717050 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tbjmj_7f9eddaf-0240-4089-b8bc-f52721de7a56/node-ca/0.log" Jul 02 21:19:58.264473 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.264430 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:58.264654 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.264517 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:19:58.264654 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.264611 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:06.264593402 +0000 UTC m=+62.565387808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:58.264654 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.264628 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:58.264778 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.264666 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:06.264655134 +0000 UTC m=+62.565449541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : secret "router-metrics-certs-default" not found Jul 02 21:19:58.365394 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.365355 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:58.365559 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.365406 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:19:58.365559 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.365458 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:19:58.365559 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.365474 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:58.365559 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.365533 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.3655185 +0000 UTC m=+58.666312910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : configmap "kube-rbac-proxy" not found Jul 02 21:19:58.365705 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.365588 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:58.365705 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.365644 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls podName:6d3755ce-b5be-409a-ba9d-7e96dd99c5bb nodeName:}" failed. No retries permitted until 2026-07-02 21:20:06.365632358 +0000 UTC m=+62.666426765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkfm" (UID: "6d3755ce-b5be-409a-ba9d-7e96dd99c5bb") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:19:58.365705 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.365588 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:58.365705 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.365682 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.365672875 +0000 UTC m=+58.666467282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:58.466455 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.466412 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:19:58.466617 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.466532 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 21:19:58.466617 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:19:58.466586 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls podName:9f7879bb-888b-4855-ba42-c13be0e73b97 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:06.466572769 +0000 UTC m=+62.767367176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9m5x4" (UID: "9f7879bb-888b-4855-ba42-c13be0e73b97") : secret "samples-operator-tls" not found Jul 02 21:19:58.518390 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:19:58.518273 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-srm2w_dabb5f36-2206-455f-a785-d48f69bfef9f/serve-healthcheck-canary/0.log" Jul 02 21:20:02.395485 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:02.395447 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:02.395874 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:02.395530 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:02.395874 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:02.395572 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:20:02.395874 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:02.395629 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:20:02.395874 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:02.395641 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.395624002 +0000 UTC m=+66.696418409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : configmap "kube-rbac-proxy" not found Jul 02 21:20:02.395874 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:02.395671 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.395660066 +0000 UTC m=+66.696454473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : secret "insights-runtime-extractor-tls" not found Jul 02 21:20:06.332488 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.332444 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:06.332968 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.332555 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:06.332968 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:06.332689 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle podName:9bf0a887-dedc-44ac-a3fb-ad6392975200 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:22.332670851 +0000 UTC m=+78.633465258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle") pod "router-default-69c64548d9-5wp72" (UID: "9bf0a887-dedc-44ac-a3fb-ad6392975200") : configmap references non-existent config key: service-ca.crt Jul 02 21:20:06.335127 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.335101 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bf0a887-dedc-44ac-a3fb-ad6392975200-metrics-certs\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:06.433076 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.433031 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:20:06.433252 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:06.433199 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 21:20:06.433293 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:06.433273 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls podName:6d3755ce-b5be-409a-ba9d-7e96dd99c5bb nodeName:}" failed. No retries permitted until 2026-07-02 21:20:22.433257016 +0000 UTC m=+78.734051423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bxkfm" (UID: "6d3755ce-b5be-409a-ba9d-7e96dd99c5bb") : secret "cluster-monitoring-operator-tls" not found Jul 02 21:20:06.533997 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.533962 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:20:06.536613 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.536587 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f7879bb-888b-4855-ba42-c13be0e73b97-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9m5x4\" (UID: \"9f7879bb-888b-4855-ba42-c13be0e73b97\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:20:06.617812 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.617732 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dp5kg\"" Jul 02 21:20:06.625771 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.625742 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" Jul 02 21:20:06.762513 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:06.762373 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4"] Jul 02 21:20:07.567791 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:07.567762 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28cz9" Jul 02 21:20:07.645281 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:07.645243 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" event={"ID":"9f7879bb-888b-4855-ba42-c13be0e73b97","Type":"ContainerStarted","Data":"ad9d0a56c775615d85a7c7c02afb6bf94d6741bf64798059d5d50d37275fc5f1"} Jul 02 21:20:09.652923 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:09.652886 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" event={"ID":"9f7879bb-888b-4855-ba42-c13be0e73b97","Type":"ContainerStarted","Data":"098b2832403c38e2de8f0ae5538a9272d4277323248b15cbe7be6e1de117ba69"} Jul 02 21:20:09.653407 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:09.652986 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" event={"ID":"9f7879bb-888b-4855-ba42-c13be0e73b97","Type":"ContainerStarted","Data":"07cade7bf8f38c02a7e11028a25fcd87ee0e7d84768946b144e4cd985a19d6e9"} Jul 02 21:20:09.685369 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:09.685298 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9m5x4" podStartSLOduration=17.72236607 podStartE2EDuration="19.685284087s" totalImagesPullingTime="1.962918017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:09.684651787 +0000 UTC m=+65.985446216" watchObservedRunningTime="2026-07-02 21:20:09.685284087 +0000 UTC m=+65.986078515" Jul 02 21:20:10.066184 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.066148 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:20:10.066366 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.066205 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:20:10.069944 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.069922 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:20:10.070010 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.069922 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:20:10.079117 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.079091 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34ed7b7-7ec0-465a-b36e-b5520d643fc4-original-pull-secret\") pod \"global-pull-secret-syncer-mjbss\" (UID: \"e34ed7b7-7ec0-465a-b36e-b5520d643fc4\") " pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:20:10.079244 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.079184 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d639562-6612-4749-aac9-93156846b5f3-metrics-certs\") pod \"network-metrics-daemon-4vkrs\" (UID: \"7d639562-6612-4749-aac9-93156846b5f3\") " pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:20:10.103262 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.103226 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjbss" Jul 02 21:20:10.119371 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.119341 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6k252\"" Jul 02 21:20:10.126761 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.126737 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vkrs" Jul 02 21:20:10.167201 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.167171 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:20:10.173147 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.172905 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:20:10.182214 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.182188 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:20:10.194249 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.194204 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzlqf\" (UniqueName: \"kubernetes.io/projected/fe001302-d790-4a79-b07f-63ff03496eda-kube-api-access-gzlqf\") pod \"network-check-target-jsb68\" (UID: \"fe001302-d790-4a79-b07f-63ff03496eda\") " pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:20:10.272041 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.272020 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mjbss"] Jul 02 21:20:10.273847 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:10.273822 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34ed7b7_7ec0_465a_b36e_b5520d643fc4.slice/crio-763849e833d6a8581f21afde8048bb18aca70bc295bb9cde0feefb1417878961 WatchSource:0}: Error finding container 763849e833d6a8581f21afde8048bb18aca70bc295bb9cde0feefb1417878961: Status 404 returned error can't find the container with id 763849e833d6a8581f21afde8048bb18aca70bc295bb9cde0feefb1417878961 Jul 02 21:20:10.288895 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.288871 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vkrs"] Jul 02 21:20:10.289616 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:10.289593 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d639562_6612_4749_aac9_93156846b5f3.slice/crio-b4217954a09cf55edae90005339def50239ab9ee12d468ca2774c9831975d269 WatchSource:0}: Error finding container b4217954a09cf55edae90005339def50239ab9ee12d468ca2774c9831975d269: Status 404 returned error can't find the container with id b4217954a09cf55edae90005339def50239ab9ee12d468ca2774c9831975d269 Jul 02 21:20:10.414075 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.414000 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bjnbk\"" Jul 02 21:20:10.422196 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.422172 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:20:10.469161 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.469126 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:10.469299 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.469210 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:10.469416 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:10.469384 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:20:10.469482 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:10.469457 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls podName:c5c05b14-d8e4-4781-9568-9f75605aeec7 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:26.469438928 +0000 UTC m=+82.770233358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fkt9s" (UID: "c5c05b14-d8e4-4781-9568-9f75605aeec7") : secret "insights-runtime-extractor-tls" not found Jul 02 21:20:10.469635 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.469611 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5c05b14-d8e4-4781-9568-9f75605aeec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:10.588053 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.588021 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsb68"] Jul 02 21:20:10.590801 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:10.590777 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe001302_d790_4a79_b07f_63ff03496eda.slice/crio-bc6e75af0328875f6a178d00f1e94aaf9fae9524453272f5e1d711219f3d4988 WatchSource:0}: Error finding container bc6e75af0328875f6a178d00f1e94aaf9fae9524453272f5e1d711219f3d4988: Status 404 returned error can't find the container with id bc6e75af0328875f6a178d00f1e94aaf9fae9524453272f5e1d711219f3d4988 Jul 02 21:20:10.656610 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.656573 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mjbss" event={"ID":"e34ed7b7-7ec0-465a-b36e-b5520d643fc4","Type":"ContainerStarted","Data":"763849e833d6a8581f21afde8048bb18aca70bc295bb9cde0feefb1417878961"} Jul 02 21:20:10.657783 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.657755 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsb68" event={"ID":"fe001302-d790-4a79-b07f-63ff03496eda","Type":"ContainerStarted","Data":"bc6e75af0328875f6a178d00f1e94aaf9fae9524453272f5e1d711219f3d4988"} Jul 02 21:20:10.658786 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:10.658764 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vkrs" event={"ID":"7d639562-6612-4749-aac9-93156846b5f3","Type":"ContainerStarted","Data":"b4217954a09cf55edae90005339def50239ab9ee12d468ca2774c9831975d269"} Jul 02 21:20:11.376557 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.376506 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:20:11.379427 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.379387 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bcdcc4c-fc8d-47a8-9465-c6e331b54766-metrics-tls\") pod \"dns-default-4vxcx\" (UID: \"0bcdcc4c-fc8d-47a8-9465-c6e331b54766\") " pod="openshift-dns/dns-default-4vxcx" Jul 02 21:20:11.642190 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.642143 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sklqf\"" Jul 02 21:20:11.648779 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.648753 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vxcx" Jul 02 21:20:11.664642 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.664605 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vkrs" event={"ID":"7d639562-6612-4749-aac9-93156846b5f3","Type":"ContainerStarted","Data":"2c030d80b151f4700f0c532e234b534b91056d474bc01a1c4a84b9dee0d98d18"} Jul 02 21:20:11.665028 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.664675 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vkrs" event={"ID":"7d639562-6612-4749-aac9-93156846b5f3","Type":"ContainerStarted","Data":"dc77ec78d2b50ac410bb8255c190f6972c3693a443a33d590e126c7c82c2c6ca"} Jul 02 21:20:11.687514 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.686969 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4vkrs" podStartSLOduration=65.589042301 podStartE2EDuration="1m6.686952595s" totalImagesPullingTime="1.097910294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:11.686388175 +0000 UTC m=+67.987182604" watchObservedRunningTime="2026-07-02 21:20:11.686952595 +0000 UTC m=+67.987747002" Jul 02 21:20:11.810826 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:11.810795 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vxcx"] Jul 02 21:20:11.814085 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:11.814053 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcdcc4c_fc8d_47a8_9465_c6e331b54766.slice/crio-4b42286b1f9ec680b164713f3a416a3bc29091bc1b447163e13d97bedb0573a1 WatchSource:0}: Error finding container 4b42286b1f9ec680b164713f3a416a3bc29091bc1b447163e13d97bedb0573a1: Status 404 returned error can't find the container with id 4b42286b1f9ec680b164713f3a416a3bc29091bc1b447163e13d97bedb0573a1 Jul 02 21:20:12.675391 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:12.675292 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxcx" event={"ID":"0bcdcc4c-fc8d-47a8-9465-c6e331b54766","Type":"ContainerStarted","Data":"4b42286b1f9ec680b164713f3a416a3bc29091bc1b447163e13d97bedb0573a1"} Jul 02 21:20:15.688769 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:15.688721 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsb68" event={"ID":"fe001302-d790-4a79-b07f-63ff03496eda","Type":"ContainerStarted","Data":"486b0bb9b2a1966857bc8d60c0479ff740296ab43eb4d4af12c9e1724b6f5154"} Jul 02 21:20:15.689198 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:15.688843 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:20:15.709527 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:15.708599 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jsb68" podStartSLOduration=65.706716959 podStartE2EDuration="1m10.708579065s" totalImagesPullingTime="5.001862106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:15.707298854 +0000 UTC m=+72.008093284" watchObservedRunningTime="2026-07-02 21:20:15.708579065 +0000 UTC m=+72.009373498" Jul 02 21:20:16.693839 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:16.693805 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mjbss" event={"ID":"e34ed7b7-7ec0-465a-b36e-b5520d643fc4","Type":"ContainerStarted","Data":"3dc9738c35fea95c8aee811138a64e49f18942f82690594faf9fadf8ce8563ab"} Jul 02 21:20:16.695587 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:16.695561 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxcx" event={"ID":"0bcdcc4c-fc8d-47a8-9465-c6e331b54766","Type":"ContainerStarted","Data":"957f2a2559e66116cd6b7bc7b6d2d7f4d97ce0dfb124b0ec9da30edb1cc229c4"} Jul 02 21:20:16.695730 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:16.695599 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxcx" event={"ID":"0bcdcc4c-fc8d-47a8-9465-c6e331b54766","Type":"ContainerStarted","Data":"f94585be011325cf53ab6ba02cdc52c79495e84aa2a4f82e10954a0a514a633d"} Jul 02 21:20:16.695730 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:16.695656 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4vxcx" Jul 02 21:20:16.712113 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:16.712068 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mjbss" podStartSLOduration=66.378642778 podStartE2EDuration="1m11.712054197s" totalImagesPullingTime="5.333411419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:16.711095342 +0000 UTC m=+73.011889772" watchObservedRunningTime="2026-07-02 21:20:16.712054197 +0000 UTC m=+73.012848625" Jul 02 21:20:16.733585 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:16.733531 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4vxcx" podStartSLOduration=33.949273106 podStartE2EDuration="37.733515568s" totalImagesPullingTime="3.784242462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:16.733436868 +0000 UTC m=+73.034231298" watchObservedRunningTime="2026-07-02 21:20:16.733515568 +0000 UTC m=+73.034309997" Jul 02 21:20:20.332331 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.332286 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl"] Jul 02 21:20:20.334569 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.334553 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.337840 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.337817 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 21:20:20.339116 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.339091 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 21:20:20.339233 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.339132 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wtswv\"" Jul 02 21:20:20.339233 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.339096 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 21:20:20.339233 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.339098 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 21:20:20.359101 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.359065 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl"] Jul 02 21:20:20.449904 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.449869 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/329900c4-922b-42e0-b7af-3d493771ed70-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl\" (UID: \"329900c4-922b-42e0-b7af-3d493771ed70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.450076 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.449917 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvvhf\" (UniqueName: \"kubernetes.io/projected/329900c4-922b-42e0-b7af-3d493771ed70-kube-api-access-jvvhf\") pod \"managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl\" (UID: \"329900c4-922b-42e0-b7af-3d493771ed70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.550516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.550481 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/329900c4-922b-42e0-b7af-3d493771ed70-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl\" (UID: \"329900c4-922b-42e0-b7af-3d493771ed70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.550678 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.550535 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvvhf\" (UniqueName: \"kubernetes.io/projected/329900c4-922b-42e0-b7af-3d493771ed70-kube-api-access-jvvhf\") pod \"managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl\" (UID: \"329900c4-922b-42e0-b7af-3d493771ed70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.553079 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.553052 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/329900c4-922b-42e0-b7af-3d493771ed70-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl\" (UID: \"329900c4-922b-42e0-b7af-3d493771ed70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.567751 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.567729 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvvhf\" (UniqueName: \"kubernetes.io/projected/329900c4-922b-42e0-b7af-3d493771ed70-kube-api-access-jvvhf\") pod \"managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl\" (UID: \"329900c4-922b-42e0-b7af-3d493771ed70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.651204 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.651130 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" Jul 02 21:20:20.794640 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:20.794615 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod329900c4_922b_42e0_b7af_3d493771ed70.slice/crio-b27629601684a39ddd8167dec46a5a46162234cff6a345a4de385366abb09acf WatchSource:0}: Error finding container b27629601684a39ddd8167dec46a5a46162234cff6a345a4de385366abb09acf: Status 404 returned error can't find the container with id b27629601684a39ddd8167dec46a5a46162234cff6a345a4de385366abb09acf Jul 02 21:20:20.806835 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:20.806802 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl"] Jul 02 21:20:21.714886 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:21.714846 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" event={"ID":"329900c4-922b-42e0-b7af-3d493771ed70","Type":"ContainerStarted","Data":"b27629601684a39ddd8167dec46a5a46162234cff6a345a4de385366abb09acf"} Jul 02 21:20:22.365164 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.365127 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:22.365910 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.365887 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf0a887-dedc-44ac-a3fb-ad6392975200-service-ca-bundle\") pod \"router-default-69c64548d9-5wp72\" (UID: \"9bf0a887-dedc-44ac-a3fb-ad6392975200\") " pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:22.466170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.466128 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:20:22.468847 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.468823 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3755ce-b5be-409a-ba9d-7e96dd99c5bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bxkfm\" (UID: \"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:20:22.610407 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.610370 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-glqcf\"" Jul 02 21:20:22.617615 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.617551 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:22.634695 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.634676 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-89c4r\"" Jul 02 21:20:22.642227 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:22.642206 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" Jul 02 21:20:23.008257 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.008229 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69c64548d9-5wp72"] Jul 02 21:20:23.010477 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:23.010454 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf0a887_dedc_44ac_a3fb_ad6392975200.slice/crio-b41d4ca364caeb5739578aa954ec8647d142e4ceddd29568ef4c8fa419da839d WatchSource:0}: Error finding container b41d4ca364caeb5739578aa954ec8647d142e4ceddd29568ef4c8fa419da839d: Status 404 returned error can't find the container with id b41d4ca364caeb5739578aa954ec8647d142e4ceddd29568ef4c8fa419da839d Jul 02 21:20:23.019812 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.019790 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm"] Jul 02 21:20:23.022903 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:23.022877 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3755ce_b5be_409a_ba9d_7e96dd99c5bb.slice/crio-0652bb2e8f430b1a8806e38deebe2ff611f72a1171dc46897631a23ee9be3a25 WatchSource:0}: Error finding container 0652bb2e8f430b1a8806e38deebe2ff611f72a1171dc46897631a23ee9be3a25: Status 404 returned error can't find the container with id 0652bb2e8f430b1a8806e38deebe2ff611f72a1171dc46897631a23ee9be3a25 Jul 02 21:20:23.724301 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.724257 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69c64548d9-5wp72" event={"ID":"9bf0a887-dedc-44ac-a3fb-ad6392975200","Type":"ContainerStarted","Data":"29c4b8a9df1c48e5e511e76c7166787ada5c27f0cba2aca42c17901c77b1575a"} Jul 02 21:20:23.724483 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.724335 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69c64548d9-5wp72" event={"ID":"9bf0a887-dedc-44ac-a3fb-ad6392975200","Type":"ContainerStarted","Data":"b41d4ca364caeb5739578aa954ec8647d142e4ceddd29568ef4c8fa419da839d"} Jul 02 21:20:23.725617 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.725588 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" event={"ID":"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb","Type":"ContainerStarted","Data":"0652bb2e8f430b1a8806e38deebe2ff611f72a1171dc46897631a23ee9be3a25"} Jul 02 21:20:23.727153 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.727129 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" event={"ID":"329900c4-922b-42e0-b7af-3d493771ed70","Type":"ContainerStarted","Data":"0bc632f63e87456f6d1a362f637703780c3b00fc8c7ec3dd61cbe2a9c6341c26"} Jul 02 21:20:23.755101 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.755053 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69c64548d9-5wp72" podStartSLOduration=33.755038819 podStartE2EDuration="33.755038819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:23.753745091 +0000 UTC m=+80.054539520" watchObservedRunningTime="2026-07-02 21:20:23.755038819 +0000 UTC m=+80.055833247" Jul 02 21:20:23.774499 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:23.774462 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd7cbbb44-qjtsl" podStartSLOduration=1.63739795 podStartE2EDuration="3.774448676s" totalImagesPullingTime="2.137050726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:23.773131483 +0000 UTC m=+80.073925911" watchObservedRunningTime="2026-07-02 21:20:23.774448676 +0000 UTC m=+80.075243105" Jul 02 21:20:24.618719 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:24.618685 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:24.621803 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:24.621778 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:24.730045 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:24.730018 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:24.731253 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:24.731232 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69c64548d9-5wp72" Jul 02 21:20:25.234489 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.234452 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57"] Jul 02 21:20:25.237452 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.237431 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:25.240100 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.240075 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 21:20:25.240197 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.240135 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gckbz\"" Jul 02 21:20:25.246723 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.246703 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57"] Jul 02 21:20:25.290107 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.290073 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d239fb89-4c49-41f9-9789-1a5ee354dd26-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-t5x57\" (UID: \"d239fb89-4c49-41f9-9789-1a5ee354dd26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:25.391212 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.391170 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d239fb89-4c49-41f9-9789-1a5ee354dd26-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-t5x57\" (UID: \"d239fb89-4c49-41f9-9789-1a5ee354dd26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:25.391417 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:25.391338 2550 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 21:20:25.391417 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:20:25.391406 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d239fb89-4c49-41f9-9789-1a5ee354dd26-tls-certificates podName:d239fb89-4c49-41f9-9789-1a5ee354dd26 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:25.891390768 +0000 UTC m=+82.192185176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d239fb89-4c49-41f9-9789-1a5ee354dd26-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-t5x57" (UID: "d239fb89-4c49-41f9-9789-1a5ee354dd26") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 21:20:25.734695 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.734658 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" event={"ID":"6d3755ce-b5be-409a-ba9d-7e96dd99c5bb","Type":"ContainerStarted","Data":"a36e087ef0d82c2a22ea3eba598825bea545e8ace892d48a87c9e9ecc00cea98"} Jul 02 21:20:25.752583 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.752528 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bxkfm" podStartSLOduration=34.07289405 podStartE2EDuration="35.752509898s" totalImagesPullingTime="1.679615848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:25.752083236 +0000 UTC m=+82.052877667" watchObservedRunningTime="2026-07-02 21:20:25.752509898 +0000 UTC m=+82.053304327" Jul 02 21:20:25.895623 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.895586 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d239fb89-4c49-41f9-9789-1a5ee354dd26-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-t5x57\" (UID: \"d239fb89-4c49-41f9-9789-1a5ee354dd26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:25.898263 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:25.898236 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d239fb89-4c49-41f9-9789-1a5ee354dd26-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-t5x57\" (UID: \"d239fb89-4c49-41f9-9789-1a5ee354dd26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:26.146924 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.146890 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:26.275468 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.275436 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57"] Jul 02 21:20:26.278246 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:26.278220 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd239fb89_4c49_41f9_9789_1a5ee354dd26.slice/crio-fd433b8a64118c7d6cf5d3245093873d70ddadd30ed00bedc6a8dc6fe3e55b16 WatchSource:0}: Error finding container fd433b8a64118c7d6cf5d3245093873d70ddadd30ed00bedc6a8dc6fe3e55b16: Status 404 returned error can't find the container with id fd433b8a64118c7d6cf5d3245093873d70ddadd30ed00bedc6a8dc6fe3e55b16 Jul 02 21:20:26.499775 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.499690 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:26.502050 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.502027 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5c05b14-d8e4-4781-9568-9f75605aeec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fkt9s\" (UID: \"c5c05b14-d8e4-4781-9568-9f75605aeec7\") " pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:26.700659 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.700632 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4vxcx" Jul 02 21:20:26.739519 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.739485 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" event={"ID":"d239fb89-4c49-41f9-9789-1a5ee354dd26","Type":"ContainerStarted","Data":"fd433b8a64118c7d6cf5d3245093873d70ddadd30ed00bedc6a8dc6fe3e55b16"} Jul 02 21:20:26.787242 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.787174 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zd4gb\"" Jul 02 21:20:26.795598 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.795571 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fkt9s" Jul 02 21:20:26.946756 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:26.946723 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fkt9s"] Jul 02 21:20:26.950231 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:26.950190 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c05b14_d8e4_4781_9568_9f75605aeec7.slice/crio-1b1a7217221d0059fa547b634426002162cb6e3cc20772f1cf8b269282d34a2f WatchSource:0}: Error finding container 1b1a7217221d0059fa547b634426002162cb6e3cc20772f1cf8b269282d34a2f: Status 404 returned error can't find the container with id 1b1a7217221d0059fa547b634426002162cb6e3cc20772f1cf8b269282d34a2f Jul 02 21:20:27.746803 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:27.746718 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" event={"ID":"d239fb89-4c49-41f9-9789-1a5ee354dd26","Type":"ContainerStarted","Data":"69dc938c1bf03b14b2067ef7840e3ce6c72ce97d5ae6b2e5b9bc0b0e06da443b"} Jul 02 21:20:27.747253 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:27.747056 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:27.749069 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:27.748937 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fkt9s" event={"ID":"c5c05b14-d8e4-4781-9568-9f75605aeec7","Type":"ContainerStarted","Data":"1b1a7217221d0059fa547b634426002162cb6e3cc20772f1cf8b269282d34a2f"} Jul 02 21:20:27.752660 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:27.752635 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" Jul 02 21:20:27.765995 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:27.765941 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-t5x57" podStartSLOduration=1.703631004 podStartE2EDuration="2.76592241s" totalImagesPullingTime="1.062291406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:27.765255297 +0000 UTC m=+84.066049723" watchObservedRunningTime="2026-07-02 21:20:27.76592241 +0000 UTC m=+84.066716843" Jul 02 21:20:28.296527 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.296490 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf"] Jul 02 21:20:28.299798 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.299778 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.304603 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.303054 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 21:20:28.304603 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.303148 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 21:20:28.304603 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.304434 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-knrz9\"" Jul 02 21:20:28.304804 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.304753 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 21:20:28.307582 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.307557 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf"] Jul 02 21:20:28.415595 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.415551 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b51635b-0376-490b-8d25-c888231660bd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.415780 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.415623 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b51635b-0376-490b-8d25-c888231660bd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.415780 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.415726 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b51635b-0376-490b-8d25-c888231660bd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.415780 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.415759 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6qt\" (UniqueName: \"kubernetes.io/projected/3b51635b-0376-490b-8d25-c888231660bd-kube-api-access-tg6qt\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.517025 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.516993 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6qt\" (UniqueName: \"kubernetes.io/projected/3b51635b-0376-490b-8d25-c888231660bd-kube-api-access-tg6qt\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.517195 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.517061 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b51635b-0376-490b-8d25-c888231660bd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.517195 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.517097 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b51635b-0376-490b-8d25-c888231660bd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.517195 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.517145 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b51635b-0376-490b-8d25-c888231660bd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.517860 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.517831 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b51635b-0376-490b-8d25-c888231660bd-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.519914 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.519886 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b51635b-0376-490b-8d25-c888231660bd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.520085 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.520054 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b51635b-0376-490b-8d25-c888231660bd-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.533862 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.533838 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6qt\" (UniqueName: \"kubernetes.io/projected/3b51635b-0376-490b-8d25-c888231660bd-kube-api-access-tg6qt\") pod \"prometheus-operator-567f7b8b7c-wblsf\" (UID: \"3b51635b-0376-490b-8d25-c888231660bd\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:28.613023 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:28.612991 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" Jul 02 21:20:30.791800 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:30.791773 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf"] Jul 02 21:20:30.793834 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:30.793810 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b51635b_0376_490b_8d25_c888231660bd.slice/crio-15eea695798f2d89b40209c0af6b9298106b004715c5f9d1d183559ffd4d755d WatchSource:0}: Error finding container 15eea695798f2d89b40209c0af6b9298106b004715c5f9d1d183559ffd4d755d: Status 404 returned error can't find the container with id 15eea695798f2d89b40209c0af6b9298106b004715c5f9d1d183559ffd4d755d Jul 02 21:20:31.766850 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:31.766766 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fkt9s" event={"ID":"c5c05b14-d8e4-4781-9568-9f75605aeec7","Type":"ContainerStarted","Data":"4aa1ac937008c48fe62b5a21109a08963ecd99c06cc75d39685e2c62fabc9be0"} Jul 02 21:20:31.766850 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:31.766834 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fkt9s" event={"ID":"c5c05b14-d8e4-4781-9568-9f75605aeec7","Type":"ContainerStarted","Data":"9bef084c62a692755105f6a1741d9a92009deed65ae519c8f769b133d7b5db3f"} Jul 02 21:20:31.768084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:31.768059 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" event={"ID":"3b51635b-0376-490b-8d25-c888231660bd","Type":"ContainerStarted","Data":"15eea695798f2d89b40209c0af6b9298106b004715c5f9d1d183559ffd4d755d"} Jul 02 21:20:32.774939 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:32.774900 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" event={"ID":"3b51635b-0376-490b-8d25-c888231660bd","Type":"ContainerStarted","Data":"3396be1d9fe7fe85d9f9eda641b6b72f593bd37e7beae4e447f0ab5ee757ba70"} Jul 02 21:20:32.775365 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:32.774967 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" event={"ID":"3b51635b-0376-490b-8d25-c888231660bd","Type":"ContainerStarted","Data":"145d084409fcc5603f2f889e689d0c98a04ab116e4142669069f5ca23006d921"} Jul 02 21:20:32.799530 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:32.799370 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wblsf" podStartSLOduration=3.586325869 podStartE2EDuration="4.799353954s" totalImagesPullingTime="1.213028085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:32.797729268 +0000 UTC m=+89.098523699" watchObservedRunningTime="2026-07-02 21:20:32.799353954 +0000 UTC m=+89.100148385" Jul 02 21:20:34.728445 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.728414 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg"] Jul 02 21:20:34.731910 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.731889 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.735285 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.735262 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 21:20:34.735423 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.735405 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 21:20:34.735511 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.735477 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zhvtx\"" Jul 02 21:20:34.758730 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.758708 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg"] Jul 02 21:20:34.784572 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.784491 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fkt9s" event={"ID":"c5c05b14-d8e4-4781-9568-9f75605aeec7","Type":"ContainerStarted","Data":"762c30e0d30ab51e61e84cc97f536bf26448d73c4068097937a3c12f90b33938"} Jul 02 21:20:34.796849 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.796822 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-crn6s"] Jul 02 21:20:34.800100 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.800083 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.803914 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.803890 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-np8j8\"" Jul 02 21:20:34.804013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.803919 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 21:20:34.804013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.803948 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 21:20:34.804292 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.804270 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 21:20:34.823030 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.822910 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fkt9s" podStartSLOduration=33.79341158 podStartE2EDuration="40.822893215s" totalImagesPullingTime="7.029481635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:34.822038399 +0000 UTC m=+91.122832819" watchObservedRunningTime="2026-07-02 21:20:34.822893215 +0000 UTC m=+91.123687645" Jul 02 21:20:34.869831 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869801 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62cvs\" (UniqueName: \"kubernetes.io/projected/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-kube-api-access-62cvs\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.869831 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869834 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-sys\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.869998 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869851 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.869998 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869875 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-accelerators-collector-config\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.869998 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869894 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.869998 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869941 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-tls\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.869998 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.869991 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp72p\" (UniqueName: \"kubernetes.io/projected/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-kube-api-access-rp72p\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.870170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.870020 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-textfile\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.870170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.870039 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-metrics-client-ca\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.870170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.870076 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-root\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.870170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.870113 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-wtmp\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.870170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.870135 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.870170 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.870161 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.971425 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971386 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.971425 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971430 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.971671 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971554 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62cvs\" (UniqueName: \"kubernetes.io/projected/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-kube-api-access-62cvs\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.971671 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971588 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-sys\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971671 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971612 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971671 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971671 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-accelerators-collector-config\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971682 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-sys\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971694 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.971863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971738 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-tls\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971780 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp72p\" (UniqueName: \"kubernetes.io/projected/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-kube-api-access-rp72p\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971825 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-textfile\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.971863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.971852 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-metrics-client-ca\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972159 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972094 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-root\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972159 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972135 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-wtmp\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972264 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972193 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.972341 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972297 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-accelerators-collector-config\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972354 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-metrics-client-ca\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972519 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972486 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-wtmp\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972629 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972539 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-root\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.972629 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.972598 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-textfile\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.974292 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.974269 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.974605 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.974584 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.974746 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.974728 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-node-exporter-tls\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:34.974812 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.974741 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.980677 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.980617 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62cvs\" (UniqueName: \"kubernetes.io/projected/44ae0207-6f6a-445f-8a18-47b69a3dd6f8-kube-api-access-62cvs\") pod \"openshift-state-metrics-54cf96dfcf-8g9lg\" (UID: \"44ae0207-6f6a-445f-8a18-47b69a3dd6f8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:34.980900 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:34.980881 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp72p\" (UniqueName: \"kubernetes.io/projected/2e9234b1-5dba-4646-8a6f-6bffca0bc24e-kube-api-access-rp72p\") pod \"node-exporter-crn6s\" (UID: \"2e9234b1-5dba-4646-8a6f-6bffca0bc24e\") " pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:35.041194 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.041162 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" Jul 02 21:20:35.108971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.108943 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-crn6s" Jul 02 21:20:35.126472 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:35.126386 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9234b1_5dba_4646_8a6f_6bffca0bc24e.slice/crio-5f3f503659716cf5435f4123bd044e7d914f93af089f5a3eab0fd702cf7f31ef WatchSource:0}: Error finding container 5f3f503659716cf5435f4123bd044e7d914f93af089f5a3eab0fd702cf7f31ef: Status 404 returned error can't find the container with id 5f3f503659716cf5435f4123bd044e7d914f93af089f5a3eab0fd702cf7f31ef Jul 02 21:20:35.201623 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.201591 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg"] Jul 02 21:20:35.206870 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:35.206845 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ae0207_6f6a_445f_8a18_47b69a3dd6f8.slice/crio-fe7f7b44c8cc51678605e4cb0f03e0438af810b90b51625089b0107f330d92d3 WatchSource:0}: Error finding container fe7f7b44c8cc51678605e4cb0f03e0438af810b90b51625089b0107f330d92d3: Status 404 returned error can't find the container with id fe7f7b44c8cc51678605e4cb0f03e0438af810b90b51625089b0107f330d92d3 Jul 02 21:20:35.793175 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.793136 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crn6s" event={"ID":"2e9234b1-5dba-4646-8a6f-6bffca0bc24e","Type":"ContainerStarted","Data":"5f3f503659716cf5435f4123bd044e7d914f93af089f5a3eab0fd702cf7f31ef"} Jul 02 21:20:35.795552 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.795516 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" event={"ID":"44ae0207-6f6a-445f-8a18-47b69a3dd6f8","Type":"ContainerStarted","Data":"bd629f03a6834164c3d3bd5b28e043e224c7b73463075f136974475d80ae29ca"} Jul 02 21:20:35.795675 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.795583 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" event={"ID":"44ae0207-6f6a-445f-8a18-47b69a3dd6f8","Type":"ContainerStarted","Data":"00dffdf0ffe23aeafaa28ded9a4ef5ca8e17d3be71c987c3cd6338ab639fa7a4"} Jul 02 21:20:35.795675 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.795613 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" event={"ID":"44ae0207-6f6a-445f-8a18-47b69a3dd6f8","Type":"ContainerStarted","Data":"fe7f7b44c8cc51678605e4cb0f03e0438af810b90b51625089b0107f330d92d3"} Jul 02 21:20:35.866810 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.866775 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:20:35.871135 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.871106 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.879518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879292 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 21:20:35.879518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879338 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 21:20:35.879518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879381 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 21:20:35.879518 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879512 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 21:20:35.879813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879630 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 21:20:35.879813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879657 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 21:20:35.879813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.879745 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 21:20:35.881356 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.880890 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 21:20:35.881356 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.881180 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-94w5m\"" Jul 02 21:20:35.892856 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.892107 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 21:20:35.917241 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.917207 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:20:35.979165 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979117 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-config-volume\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979165 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979161 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979190 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-web-config\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979217 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979292 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979351 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979381 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979414 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979641 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979487 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979641 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979537 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979641 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979571 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-config-out\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979641 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979589 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:35.979641 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:35.979604 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfbj5\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-kube-api-access-zfbj5\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080811 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080779 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-config-out\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080814 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080840 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfbj5\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-kube-api-access-zfbj5\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080878 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-config-volume\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080899 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080923 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-web-config\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.080971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.080962 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081275 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081019 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081275 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081044 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081275 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081059 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081275 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081075 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081275 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081107 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081275 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081136 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.081865 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.081625 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.082448 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.082421 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.082706 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.082685 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.085277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.085251 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.086410 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.086333 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.086410 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.086382 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-config-out\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.087119 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.087064 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.087701 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.087678 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-web-config\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.087997 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.087968 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.089004 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.088972 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.089085 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.089005 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-config-volume\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.089411 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.089378 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.100519 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.100497 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfbj5\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-kube-api-access-zfbj5\") pod \"alertmanager-main-0\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.185358 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.185296 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:20:36.521803 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.521781 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:20:36.569076 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:36.569036 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f303a4_1d16_43bf_ade8_62a4153d165f.slice/crio-47d6d2febf127c70ec2c7fda5016703203f9f7a6c6ecb3e595c06ee9c83464ad WatchSource:0}: Error finding container 47d6d2febf127c70ec2c7fda5016703203f9f7a6c6ecb3e595c06ee9c83464ad: Status 404 returned error can't find the container with id 47d6d2febf127c70ec2c7fda5016703203f9f7a6c6ecb3e595c06ee9c83464ad Jul 02 21:20:36.801438 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.801402 2550 generic.go:356] "Generic (PLEG): container finished" podID="2e9234b1-5dba-4646-8a6f-6bffca0bc24e" containerID="867c0aaaf93dd5b0f98ed9bf4e12fcbd1f86401dc335f06f06b887bf713fcb9e" exitCode=0 Jul 02 21:20:36.801876 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.801481 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crn6s" event={"ID":"2e9234b1-5dba-4646-8a6f-6bffca0bc24e","Type":"ContainerDied","Data":"867c0aaaf93dd5b0f98ed9bf4e12fcbd1f86401dc335f06f06b887bf713fcb9e"} Jul 02 21:20:36.803761 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.803739 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" event={"ID":"44ae0207-6f6a-445f-8a18-47b69a3dd6f8","Type":"ContainerStarted","Data":"d187f5440ee9767f9f0c26276d43bbbb42fac28a99dd87d37f32be48b3139abb"} Jul 02 21:20:36.804990 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.804970 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"47d6d2febf127c70ec2c7fda5016703203f9f7a6c6ecb3e595c06ee9c83464ad"} Jul 02 21:20:36.828631 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.828605 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q"] Jul 02 21:20:36.833478 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.833457 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.837748 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.837724 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 21:20:36.837935 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.837915 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 21:20:36.838999 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.838978 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2shoelafq2l5q\"" Jul 02 21:20:36.839083 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.838981 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 21:20:36.839993 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.839978 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 21:20:36.839993 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.839985 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 21:20:36.840386 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.840372 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dzcgk\"" Jul 02 21:20:36.848659 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.848112 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q"] Jul 02 21:20:36.882689 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.882623 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8g9lg" podStartSLOduration=1.8733122469999999 podStartE2EDuration="2.882606364s" totalImagesPullingTime="1.009294117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:36.882513539 +0000 UTC m=+93.183307971" watchObservedRunningTime="2026-07-02 21:20:36.882606364 +0000 UTC m=+93.183400792" Jul 02 21:20:36.989376 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989343 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hld\" (UniqueName: \"kubernetes.io/projected/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-kube-api-access-v9hld\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989542 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989399 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989542 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989486 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989542 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989514 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989542 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989538 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-tls\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989696 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989586 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-metrics-client-ca\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989696 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989613 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:36.989696 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:36.989655 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-grpc-tls\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090279 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090205 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-metrics-client-ca\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090279 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090248 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090521 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090291 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-grpc-tls\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090521 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090350 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hld\" (UniqueName: \"kubernetes.io/projected/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-kube-api-access-v9hld\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090612 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090534 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090672 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090620 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090672 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090652 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.090773 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.090693 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-tls\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.091151 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.091076 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-metrics-client-ca\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.093515 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.093495 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-grpc-tls\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.093638 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.093622 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.093686 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.093646 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.093722 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.093698 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.093806 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.093780 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.094474 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.094459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-secret-thanos-querier-tls\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.100022 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.099998 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hld\" (UniqueName: \"kubernetes.io/projected/12ef60bd-ca45-4af2-a35e-4d52516ec7fb-kube-api-access-v9hld\") pod \"thanos-querier-6bbcb7bc8-rs64q\" (UID: \"12ef60bd-ca45-4af2-a35e-4d52516ec7fb\") " pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.152722 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.152693 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:37.327873 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.327845 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q"] Jul 02 21:20:37.328997 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:37.328971 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ef60bd_ca45_4af2_a35e_4d52516ec7fb.slice/crio-dd5c314306d2f3a127e3108945d86dfea4b718e937a418803b70b81b7800bd6c WatchSource:0}: Error finding container dd5c314306d2f3a127e3108945d86dfea4b718e937a418803b70b81b7800bd6c: Status 404 returned error can't find the container with id dd5c314306d2f3a127e3108945d86dfea4b718e937a418803b70b81b7800bd6c Jul 02 21:20:37.812037 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.812001 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crn6s" event={"ID":"2e9234b1-5dba-4646-8a6f-6bffca0bc24e","Type":"ContainerStarted","Data":"dda9d316974700d882f6f65c1b3b55c1c8ce792f76615f983d9ba63ffb58a440"} Jul 02 21:20:37.812523 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.812057 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crn6s" event={"ID":"2e9234b1-5dba-4646-8a6f-6bffca0bc24e","Type":"ContainerStarted","Data":"69ece74458ea61dfe8e1b95bb495667e8017f0bda5399f1be03beaa6e19a5392"} Jul 02 21:20:37.813229 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.813208 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"dd5c314306d2f3a127e3108945d86dfea4b718e937a418803b70b81b7800bd6c"} Jul 02 21:20:37.843713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:37.843665 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-crn6s" podStartSLOduration=2.54129848 podStartE2EDuration="3.843651125s" totalImagesPullingTime="1.21327738s" totalInitContainerRuntime="89.075265ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:37.841836412 +0000 UTC m=+94.142630843" watchObservedRunningTime="2026-07-02 21:20:37.843651125 +0000 UTC m=+94.144445554" Jul 02 21:20:38.818279 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:38.818246 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a" exitCode=0 Jul 02 21:20:38.818702 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:38.818351 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a"} Jul 02 21:20:39.828981 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.828943 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"207ff52976befb929b32731a88d25fa22f32975b4b5a863c7b6fc6ea3af612eb"} Jul 02 21:20:39.829377 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.829029 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"7cba013a423f333f6d53a846427a48cb4a90ba468087d23f9fe49629e01f4273"} Jul 02 21:20:39.829377 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.829072 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"8e2c5cdd3abc99f2321dab59cc87d5d490df1f5b5a908ee62deb44eda981c710"} Jul 02 21:20:39.936832 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.936793 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl"] Jul 02 21:20:39.941348 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.941324 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:39.944520 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.944236 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 21:20:39.944520 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.944329 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qbq2z\"" Jul 02 21:20:39.944520 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.944405 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 21:20:39.944782 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.944636 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 21:20:39.944782 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.944727 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 21:20:39.945234 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.945217 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 21:20:39.952545 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.952518 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 21:20:39.955702 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:39.955678 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl"] Jul 02 21:20:40.118121 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118028 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-telemeter-client-tls\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118125 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-federate-client-tls\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118157 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-secret-telemeter-client\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118195 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118277 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118262 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118524 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118292 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmbr4\" (UniqueName: \"kubernetes.io/projected/e370cff6-1234-4eb0-a391-d2410f4c5752-kube-api-access-rmbr4\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118524 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118336 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-serving-certs-ca-bundle\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.118524 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.118362 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-metrics-client-ca\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.219697 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219662 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-secret-telemeter-client\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.219864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219705 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.219864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219751 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.219864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219771 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmbr4\" (UniqueName: \"kubernetes.io/projected/e370cff6-1234-4eb0-a391-d2410f4c5752-kube-api-access-rmbr4\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.219864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219788 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-serving-certs-ca-bundle\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.219864 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219803 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-metrics-client-ca\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.220101 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.219919 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-telemeter-client-tls\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.220101 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.220020 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-federate-client-tls\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.220703 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.220625 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-serving-certs-ca-bundle\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.220814 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.220738 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.221713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.221686 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e370cff6-1234-4eb0-a391-d2410f4c5752-metrics-client-ca\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.222790 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.222710 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.223406 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.222881 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-secret-telemeter-client\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.223406 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.223286 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-federate-client-tls\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.223406 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.223388 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e370cff6-1234-4eb0-a391-d2410f4c5752-telemeter-client-tls\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.229160 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.229134 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmbr4\" (UniqueName: \"kubernetes.io/projected/e370cff6-1234-4eb0-a391-d2410f4c5752-kube-api-access-rmbr4\") pod \"telemeter-client-6c74dfb84f-bcpvl\" (UID: \"e370cff6-1234-4eb0-a391-d2410f4c5752\") " pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.253418 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.253388 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" Jul 02 21:20:40.699813 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.699785 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl"] Jul 02 21:20:40.699979 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:20:40.699953 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode370cff6_1234_4eb0_a391_d2410f4c5752.slice/crio-95a021403fe1a78a121cc26aebba04b959b2dc33bc332c18b3b2c3efd1ae1520 WatchSource:0}: Error finding container 95a021403fe1a78a121cc26aebba04b959b2dc33bc332c18b3b2c3efd1ae1520: Status 404 returned error can't find the container with id 95a021403fe1a78a121cc26aebba04b959b2dc33bc332c18b3b2c3efd1ae1520 Jul 02 21:20:40.837286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.837229 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f"} Jul 02 21:20:40.837668 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.837340 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70"} Jul 02 21:20:40.837668 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.837381 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b"} Jul 02 21:20:40.842700 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.842665 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"95183e07d8db9d0583361f01d8a65624fd02284fc68acd9afa5b298bced35755"} Jul 02 21:20:40.842787 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.842747 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"ffbee3d001c69d168aafeac51fca0a1c127faa9b0c2f14813ebaea6c265e8b20"} Jul 02 21:20:40.842825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.842791 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" event={"ID":"12ef60bd-ca45-4af2-a35e-4d52516ec7fb","Type":"ContainerStarted","Data":"5485acd14e4bf5591b0fc77b8e55882e6f0d4ffcf70212f00a9c90b416abe7d1"} Jul 02 21:20:40.844067 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.844046 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" event={"ID":"e370cff6-1234-4eb0-a391-d2410f4c5752","Type":"ContainerStarted","Data":"95a021403fe1a78a121cc26aebba04b959b2dc33bc332c18b3b2c3efd1ae1520"} Jul 02 21:20:40.844930 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.844880 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:20:40.878178 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:40.878125 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" podStartSLOduration=1.848646757 podStartE2EDuration="4.878108032s" totalImagesPullingTime="3.029461275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:40.876076292 +0000 UTC m=+97.176870722" watchObservedRunningTime="2026-07-02 21:20:40.878108032 +0000 UTC m=+97.178902460" Jul 02 21:20:41.852978 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:41.852925 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8"} Jul 02 21:20:41.853380 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:41.853041 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5"} Jul 02 21:20:41.853380 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:41.853086 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerStarted","Data":"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5"} Jul 02 21:20:41.888615 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:41.887719 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.845611946 podStartE2EDuration="6.887699559s" totalImagesPullingTime="3.027594094s" totalInitContainerRuntime="14.493519ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:41.884547542 +0000 UTC m=+98.185341971" watchObservedRunningTime="2026-07-02 21:20:41.887699559 +0000 UTC m=+98.188493989" Jul 02 21:20:42.859614 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:42.859570 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" event={"ID":"e370cff6-1234-4eb0-a391-d2410f4c5752","Type":"ContainerStarted","Data":"0e1324a4fca2b4d869759af27a1458fa083fdb6b64702edded6cd7f21f519fae"} Jul 02 21:20:42.859984 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:42.859640 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" event={"ID":"e370cff6-1234-4eb0-a391-d2410f4c5752","Type":"ContainerStarted","Data":"05e522b78d5c00e204719d1906fefac8a791851b50fd07978f21acb688134c20"} Jul 02 21:20:42.859984 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:42.859669 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" event={"ID":"e370cff6-1234-4eb0-a391-d2410f4c5752","Type":"ContainerStarted","Data":"77c11acd71e9293637fe0c261657dab7c0e2ebec660f9795b72a9ef3d076d815"} Jul 02 21:20:42.885615 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:42.885560 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c74dfb84f-bcpvl" podStartSLOduration=2.146592124 podStartE2EDuration="3.885539126s" totalImagesPullingTime="1.738947002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:42.885365915 +0000 UTC m=+99.186160346" watchObservedRunningTime="2026-07-02 21:20:42.885539126 +0000 UTC m=+99.186333556" Jul 02 21:20:46.698220 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:46.698186 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jsb68" Jul 02 21:20:46.858933 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:20:46.858907 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bbcb7bc8-rs64q" Jul 02 21:21:07.986934 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:07.986899 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7998875bf8-rwkhz"] Jul 02 21:21:08.032605 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.032577 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7998875bf8-rwkhz"] Jul 02 21:21:08.032750 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.032668 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.035627 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.035600 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 21:21:08.035776 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.035663 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ptcsr\"" Jul 02 21:21:08.035776 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.035676 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 21:21:08.035776 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.035663 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 21:21:08.035776 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.035680 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 21:21:08.036520 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.036456 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 21:21:08.036630 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.036489 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 21:21:08.036630 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.036614 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 21:21:08.042181 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.042165 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 21:21:08.144746 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144709 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-trusted-ca-bundle\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.144929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144760 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-service-ca\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.144929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144791 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-serving-cert\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.144929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144821 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-console-config\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.144929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144844 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-758rq\" (UniqueName: \"kubernetes.io/projected/b345fcf2-f88e-496b-9413-52efc8326fe6-kube-api-access-758rq\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.144929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144912 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-oauth-serving-cert\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.145118 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.144941 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-oauth-config\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.245748 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.245674 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-trusted-ca-bundle\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.245748 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.245718 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-service-ca\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.245748 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.245738 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-serving-cert\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.245985 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.245759 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-console-config\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.245985 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.245778 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-758rq\" (UniqueName: \"kubernetes.io/projected/b345fcf2-f88e-496b-9413-52efc8326fe6-kube-api-access-758rq\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.246106 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.245976 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-oauth-serving-cert\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.246106 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.246021 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-oauth-config\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.246559 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.246523 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-console-config\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.246690 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.246675 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-oauth-serving-cert\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.246758 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.246675 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-service-ca\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.246758 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.246723 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-trusted-ca-bundle\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.248245 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.248221 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-serving-cert\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.248588 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.248566 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-oauth-config\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.254228 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.254199 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-758rq\" (UniqueName: \"kubernetes.io/projected/b345fcf2-f88e-496b-9413-52efc8326fe6-kube-api-access-758rq\") pod \"console-7998875bf8-rwkhz\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.342537 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.342506 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:08.545344 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.545258 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7998875bf8-rwkhz"] Jul 02 21:21:08.547695 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:21:08.547665 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb345fcf2_f88e_496b_9413_52efc8326fe6.slice/crio-b973561345800d8b40d0b4dc4490e81954f594dbdd6cf9b75f9a1f73adecd6a8 WatchSource:0}: Error finding container b973561345800d8b40d0b4dc4490e81954f594dbdd6cf9b75f9a1f73adecd6a8: Status 404 returned error can't find the container with id b973561345800d8b40d0b4dc4490e81954f594dbdd6cf9b75f9a1f73adecd6a8 Jul 02 21:21:08.963818 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:08.963783 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7998875bf8-rwkhz" event={"ID":"b345fcf2-f88e-496b-9413-52efc8326fe6","Type":"ContainerStarted","Data":"b973561345800d8b40d0b4dc4490e81954f594dbdd6cf9b75f9a1f73adecd6a8"} Jul 02 21:21:11.978680 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:11.978645 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7998875bf8-rwkhz" event={"ID":"b345fcf2-f88e-496b-9413-52efc8326fe6","Type":"ContainerStarted","Data":"f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704"} Jul 02 21:21:11.998704 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:11.998657 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7998875bf8-rwkhz" podStartSLOduration=2.238256301 podStartE2EDuration="4.998640823s" totalImagesPullingTime="2.760384522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:21:11.997222877 +0000 UTC m=+128.298017307" watchObservedRunningTime="2026-07-02 21:21:11.998640823 +0000 UTC m=+128.299435252" Jul 02 21:21:14.996395 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:14.996360 2550 generic.go:356] "Generic (PLEG): container finished" podID="818db894-96da-498c-8245-f8dd288601cc" containerID="03fbd35ba5ad3e0e969bfbdac7831895d0898a07e01083ef1864afd645876d5a" exitCode=0 Jul 02 21:21:14.996833 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:14.996425 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" event={"ID":"818db894-96da-498c-8245-f8dd288601cc","Type":"ContainerDied","Data":"03fbd35ba5ad3e0e969bfbdac7831895d0898a07e01083ef1864afd645876d5a"} Jul 02 21:21:14.996833 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:14.996755 2550 scope.go:117] "RemoveContainer" containerID="03fbd35ba5ad3e0e969bfbdac7831895d0898a07e01083ef1864afd645876d5a" Jul 02 21:21:16.002744 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:16.002708 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-5qf9s" event={"ID":"818db894-96da-498c-8245-f8dd288601cc","Type":"ContainerStarted","Data":"542ef416e7379abe24b8174786db8b0968254d83699594b870386a6ca436e2c0"} Jul 02 21:21:18.343618 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:18.343584 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:18.344020 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:18.343638 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:18.348179 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:18.348159 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:19.018670 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:19.018640 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:21:55.216262 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216178 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:21:55.216754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216456 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="alertmanager" containerID="cri-o://0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b" gracePeriod=120 Jul 02 21:21:55.216754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216557 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-web" containerID="cri-o://986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f" gracePeriod=120 Jul 02 21:21:55.216754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216588 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy" containerID="cri-o://50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5" gracePeriod=120 Jul 02 21:21:55.216754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216627 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="config-reloader" containerID="cri-o://ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70" gracePeriod=120 Jul 02 21:21:55.216754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216549 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-metric" containerID="cri-o://eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5" gracePeriod=120 Jul 02 21:21:55.216754 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:55.216613 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="prom-label-proxy" containerID="cri-o://5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8" gracePeriod=120 Jul 02 21:21:56.163437 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163406 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8" exitCode=0 Jul 02 21:21:56.163437 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163431 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5" exitCode=0 Jul 02 21:21:56.163437 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163439 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70" exitCode=0 Jul 02 21:21:56.163437 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163445 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b" exitCode=0 Jul 02 21:21:56.163705 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163485 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8"} Jul 02 21:21:56.163705 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163548 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5"} Jul 02 21:21:56.163705 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163576 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70"} Jul 02 21:21:56.163705 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.163601 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b"} Jul 02 21:21:56.469054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.469030 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:56.556618 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556589 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfbj5\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-kube-api-access-zfbj5\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.556809 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556639 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-metrics-client-ca\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.556809 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556676 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.556809 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556700 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-config-out\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.556809 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556740 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557042 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556889 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-tls-assets\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557042 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556933 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-web-config\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557042 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.556963 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-main-tls\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557042 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557023 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-trusted-ca-bundle\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557250 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557054 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-cluster-tls-config\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557250 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557079 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-web\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557250 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557091 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:56.557250 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557103 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-main-db\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557250 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557176 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-config-volume\") pod \"40f303a4-1d16-43bf-ade8-62a4153d165f\" (UID: \"40f303a4-1d16-43bf-ade8-62a4153d165f\") " Jul 02 21:21:56.557734 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557528 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:21:56.557800 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557740 2550 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-main-db\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.557800 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557763 2550 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-metrics-client-ca\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.558240 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.557900 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:56.559801 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.559759 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-kube-api-access-zfbj5" (OuterVolumeSpecName: "kube-api-access-zfbj5") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "kube-api-access-zfbj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:21:56.559979 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.559952 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-config-out" (OuterVolumeSpecName: "config-out") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:21:56.559979 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.559958 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.560538 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.560509 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.560630 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.560536 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-config-volume" (OuterVolumeSpecName: "config-volume") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.560713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.560689 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:21:56.561020 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.560993 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.561529 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.561510 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.566124 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.566097 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.571743 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.571720 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-web-config" (OuterVolumeSpecName: "web-config") pod "40f303a4-1d16-43bf-ade8-62a4153d165f" (UID: "40f303a4-1d16-43bf-ade8-62a4153d165f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:56.658662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658614 2550 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f303a4-1d16-43bf-ade8-62a4153d165f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658658 2550 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-cluster-tls-config\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658669 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658662 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658680 2550 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-config-volume\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658689 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfbj5\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-kube-api-access-zfbj5\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658697 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658706 2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f303a4-1d16-43bf-ade8-62a4153d165f-config-out\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658714 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658722 2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f303a4-1d16-43bf-ade8-62a4153d165f-tls-assets\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658729 2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-web-config\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:56.658922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:56.658737 2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f303a4-1d16-43bf-ade8-62a4153d165f-secret-alertmanager-main-tls\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:21:57.170759 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170723 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5" exitCode=0 Jul 02 21:21:57.170759 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170750 2550 generic.go:356] "Generic (PLEG): container finished" podID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerID="986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f" exitCode=0 Jul 02 21:21:57.170960 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170777 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5"} Jul 02 21:21:57.170960 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170803 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.170960 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170845 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f"} Jul 02 21:21:57.170960 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170872 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f303a4-1d16-43bf-ade8-62a4153d165f","Type":"ContainerDied","Data":"47d6d2febf127c70ec2c7fda5016703203f9f7a6c6ecb3e595c06ee9c83464ad"} Jul 02 21:21:57.170960 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.170914 2550 scope.go:117] "RemoveContainer" containerID="5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8" Jul 02 21:21:57.182251 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.181460 2550 scope.go:117] "RemoveContainer" containerID="eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5" Jul 02 21:21:57.189678 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.189659 2550 scope.go:117] "RemoveContainer" containerID="50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5" Jul 02 21:21:57.194749 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.194689 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:21:57.197325 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.197288 2550 scope.go:117] "RemoveContainer" containerID="986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f" Jul 02 21:21:57.199130 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.199111 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:21:57.204953 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.204938 2550 scope.go:117] "RemoveContainer" containerID="ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70" Jul 02 21:21:57.212041 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.212026 2550 scope.go:117] "RemoveContainer" containerID="0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b" Jul 02 21:21:57.219084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.219067 2550 scope.go:117] "RemoveContainer" containerID="eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a" Jul 02 21:21:57.226001 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.225868 2550 scope.go:117] "RemoveContainer" containerID="5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8" Jul 02 21:21:57.226223 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.226196 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8\": container with ID starting with 5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8 not found: ID does not exist" containerID="5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8" Jul 02 21:21:57.226339 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.226234 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8"} err="failed to get container status \"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8\": rpc error: code = NotFound desc = could not find container \"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8\": container with ID starting with 5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8 not found: ID does not exist" Jul 02 21:21:57.226339 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.226275 2550 scope.go:117] "RemoveContainer" containerID="eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5" Jul 02 21:21:57.226593 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.226566 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5\": container with ID starting with eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5 not found: ID does not exist" containerID="eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5" Jul 02 21:21:57.226696 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.226599 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5"} err="failed to get container status \"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5\": rpc error: code = NotFound desc = could not find container \"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5\": container with ID starting with eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5 not found: ID does not exist" Jul 02 21:21:57.226696 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.226620 2550 scope.go:117] "RemoveContainer" containerID="50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5" Jul 02 21:21:57.226966 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.226943 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5\": container with ID starting with 50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5 not found: ID does not exist" containerID="50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5" Jul 02 21:21:57.227054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.226972 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5"} err="failed to get container status \"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5\": rpc error: code = NotFound desc = could not find container \"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5\": container with ID starting with 50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5 not found: ID does not exist" Jul 02 21:21:57.227054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227019 2550 scope.go:117] "RemoveContainer" containerID="986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f" Jul 02 21:21:57.227355 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.227332 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f\": container with ID starting with 986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f not found: ID does not exist" containerID="986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f" Jul 02 21:21:57.227414 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227363 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f"} err="failed to get container status \"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f\": rpc error: code = NotFound desc = could not find container \"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f\": container with ID starting with 986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f not found: ID does not exist" Jul 02 21:21:57.227414 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227382 2550 scope.go:117] "RemoveContainer" containerID="ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70" Jul 02 21:21:57.227662 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.227644 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70\": container with ID starting with ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70 not found: ID does not exist" containerID="ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70" Jul 02 21:21:57.227701 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227667 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70"} err="failed to get container status \"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70\": rpc error: code = NotFound desc = could not find container \"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70\": container with ID starting with ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70 not found: ID does not exist" Jul 02 21:21:57.227701 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227683 2550 scope.go:117] "RemoveContainer" containerID="0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b" Jul 02 21:21:57.227914 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.227899 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b\": container with ID starting with 0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b not found: ID does not exist" containerID="0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b" Jul 02 21:21:57.227958 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227918 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b"} err="failed to get container status \"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b\": rpc error: code = NotFound desc = could not find container \"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b\": container with ID starting with 0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b not found: ID does not exist" Jul 02 21:21:57.227958 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227931 2550 scope.go:117] "RemoveContainer" containerID="eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a" Jul 02 21:21:57.227958 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.227937 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:21:57.228139 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:21:57.228123 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a\": container with ID starting with eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a not found: ID does not exist" containerID="eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a" Jul 02 21:21:57.228178 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228142 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a"} err="failed to get container status \"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a\": rpc error: code = NotFound desc = could not find container \"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a\": container with ID starting with eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a not found: ID does not exist" Jul 02 21:21:57.228178 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228155 2550 scope.go:117] "RemoveContainer" containerID="5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8" Jul 02 21:21:57.228250 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228240 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="config-reloader" Jul 02 21:21:57.228290 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228252 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="config-reloader" Jul 02 21:21:57.228290 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228259 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy" Jul 02 21:21:57.228290 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228266 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy" Jul 02 21:21:57.228290 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228282 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="prom-label-proxy" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228292 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="prom-label-proxy" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228304 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-web" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228328 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-web" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228343 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="alertmanager" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228352 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="alertmanager" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228366 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="init-config-reloader" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228374 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="init-config-reloader" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228386 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-metric" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228387 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8"} err="failed to get container status \"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8\": rpc error: code = NotFound desc = could not find container \"5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8\": container with ID starting with 5e324cbba7ad71b746e025d38075b44acb4c2e18ef1f75a24f1c3676d1bbbec8 not found: ID does not exist" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228406 2550 scope.go:117] "RemoveContainer" containerID="eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5" Jul 02 21:21:57.228516 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228394 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-metric" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228520 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="prom-label-proxy" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228538 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="config-reloader" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228548 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228556 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="alertmanager" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228563 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-metric" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228568 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" containerName="kube-rbac-proxy-web" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228656 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5"} err="failed to get container status \"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5\": rpc error: code = NotFound desc = could not find container \"eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5\": container with ID starting with eaae5f2d971ad7296b2a6975ceef3229b58682db6fc55eb29329dfd18385a0d5 not found: ID does not exist" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228673 2550 scope.go:117] "RemoveContainer" containerID="50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228856 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5"} err="failed to get container status \"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5\": rpc error: code = NotFound desc = could not find container \"50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5\": container with ID starting with 50354c6e37f11a2a03bf79f524e72b4e04565421bab8e4eef102d353deb19bc5 not found: ID does not exist" Jul 02 21:21:57.228915 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.228871 2550 scope.go:117] "RemoveContainer" containerID="986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f" Jul 02 21:21:57.229329 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229189 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f"} err="failed to get container status \"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f\": rpc error: code = NotFound desc = could not find container \"986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f\": container with ID starting with 986ce879e76b762f3fc5b684f9e32405d9de44a8bb28191ab1104cb735eff38f not found: ID does not exist" Jul 02 21:21:57.229329 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229215 2550 scope.go:117] "RemoveContainer" containerID="ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70" Jul 02 21:21:57.229538 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229518 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70"} err="failed to get container status \"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70\": rpc error: code = NotFound desc = could not find container \"ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70\": container with ID starting with ff68588098abd5dac7c6ec97cbd9151d8f2e807b602e736015d2698fe5822e70 not found: ID does not exist" Jul 02 21:21:57.229590 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229539 2550 scope.go:117] "RemoveContainer" containerID="0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b" Jul 02 21:21:57.229774 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229755 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b"} err="failed to get container status \"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b\": rpc error: code = NotFound desc = could not find container \"0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b\": container with ID starting with 0c2bbe5984d256b98061614f92acbdc1a408ca9a5733b40c5272bfbd9802d69b not found: ID does not exist" Jul 02 21:21:57.229827 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229775 2550 scope.go:117] "RemoveContainer" containerID="eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a" Jul 02 21:21:57.229991 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.229975 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a"} err="failed to get container status \"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a\": rpc error: code = NotFound desc = could not find container \"eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a\": container with ID starting with eaf3b3d348061651a7a0f309dd85d78ca7128922df02200a49b2d6abe8d00d6a not found: ID does not exist" Jul 02 21:21:57.235945 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.235926 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.238411 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238372 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 21:21:57.238411 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238393 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 21:21:57.238590 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238371 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 21:21:57.238590 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238372 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 21:21:57.238704 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238569 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 21:21:57.238704 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238637 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 21:21:57.238794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238776 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-94w5m\"" Jul 02 21:21:57.238841 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.238829 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 21:21:57.239097 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.239083 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 21:21:57.243965 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.243944 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 21:21:57.248587 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.248565 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:21:57.264604 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264574 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264604 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264608 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd98af81-4865-47ea-817e-f6aa8ccb0fae-config-out\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264628 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264649 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264722 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5fv9\" (UniqueName: \"kubernetes.io/projected/bd98af81-4865-47ea-817e-f6aa8ccb0fae-kube-api-access-j5fv9\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264794 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264765 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd98af81-4865-47ea-817e-f6aa8ccb0fae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264806 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd98af81-4865-47ea-817e-f6aa8ccb0fae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264838 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264864 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-web-config\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264911 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264937 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264962 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd98af81-4865-47ea-817e-f6aa8ccb0fae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.264996 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.264991 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd98af81-4865-47ea-817e-f6aa8ccb0fae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366243 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366203 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd98af81-4865-47ea-817e-f6aa8ccb0fae-config-out\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366243 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366248 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366507 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366277 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366507 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366296 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5fv9\" (UniqueName: \"kubernetes.io/projected/bd98af81-4865-47ea-817e-f6aa8ccb0fae-kube-api-access-j5fv9\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366507 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366460 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd98af81-4865-47ea-817e-f6aa8ccb0fae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366507 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd98af81-4865-47ea-817e-f6aa8ccb0fae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366546 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366656 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366576 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-web-config\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366808 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366753 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366808 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366786 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366909 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366816 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd98af81-4865-47ea-817e-f6aa8ccb0fae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.366909 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366853 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd98af81-4865-47ea-817e-f6aa8ccb0fae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.367001 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.366924 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.368128 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.367783 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd98af81-4865-47ea-817e-f6aa8ccb0fae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.369376 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.369344 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd98af81-4865-47ea-817e-f6aa8ccb0fae-config-out\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.369536 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.369514 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-web-config\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.369743 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.369719 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.369825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.369767 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.369825 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.369805 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd98af81-4865-47ea-817e-f6aa8ccb0fae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.370086 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.369934 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.370285 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.370264 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd98af81-4865-47ea-817e-f6aa8ccb0fae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.370508 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.370491 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd98af81-4865-47ea-817e-f6aa8ccb0fae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.370508 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.370500 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.370638 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.370494 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.371592 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.371572 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd98af81-4865-47ea-817e-f6aa8ccb0fae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.374598 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.374582 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5fv9\" (UniqueName: \"kubernetes.io/projected/bd98af81-4865-47ea-817e-f6aa8ccb0fae-kube-api-access-j5fv9\") pod \"alertmanager-main-0\" (UID: \"bd98af81-4865-47ea-817e-f6aa8ccb0fae\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.546570 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.546483 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 21:21:57.689207 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:57.689166 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 21:21:57.693216 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:21:57.693190 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd98af81_4865_47ea_817e_f6aa8ccb0fae.slice/crio-2bc28782262b0fe30ac33270818c53ffa57f480483209ef159fee9691b3eb8ed WatchSource:0}: Error finding container 2bc28782262b0fe30ac33270818c53ffa57f480483209ef159fee9691b3eb8ed: Status 404 returned error can't find the container with id 2bc28782262b0fe30ac33270818c53ffa57f480483209ef159fee9691b3eb8ed Jul 02 21:21:58.176876 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:58.176843 2550 generic.go:356] "Generic (PLEG): container finished" podID="bd98af81-4865-47ea-817e-f6aa8ccb0fae" containerID="cc34d82bd959a913cee35c71fe6166b5783286e372823de62c761efe68ecab08" exitCode=0 Jul 02 21:21:58.177055 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:58.176931 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerDied","Data":"cc34d82bd959a913cee35c71fe6166b5783286e372823de62c761efe68ecab08"} Jul 02 21:21:58.177055 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:58.176999 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"2bc28782262b0fe30ac33270818c53ffa57f480483209ef159fee9691b3eb8ed"} Jul 02 21:21:58.296715 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:58.296684 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40f303a4-1d16-43bf-ade8-62a4153d165f" path="/var/lib/kubelet/pods/40f303a4-1d16-43bf-ade8-62a4153d165f/volumes" Jul 02 21:21:59.184636 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.184597 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"bf09064408eb3c7668efd748caa139a6632984b770539bcdb280490e381b0169"} Jul 02 21:21:59.185013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.184678 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"762431a38a5955af618d79a32105ce9b3597fe318fb24222a626481ace6b1410"} Jul 02 21:21:59.185013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.184718 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"188e8eada5912ddd9ae6c1aa09911b0d294d75ebba9f83d361f6671f0a7afe74"} Jul 02 21:21:59.185013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.184757 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"d93f18aa4414637893f061606c08d832675fbe34c5e08b07c89317473580e1ef"} Jul 02 21:21:59.185013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.184792 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"fccaebe871d0cc2df32967125792f8642f9027ddb4c15d5c8df083d35e1f84cc"} Jul 02 21:21:59.185013 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.184825 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd98af81-4865-47ea-817e-f6aa8ccb0fae","Type":"ContainerStarted","Data":"4e98b31ea1e3ac5f7052dc2b8babc69d67717237aee42032f4705cd31c55a910"} Jul 02 21:21:59.212881 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:21:59.212830 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.198454571 podStartE2EDuration="2.212813132s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.358561ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:21:59.21070192 +0000 UTC m=+175.511496349" watchObservedRunningTime="2026-07-02 21:21:59.212813132 +0000 UTC m=+175.513607561" Jul 02 21:22:22.982252 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:22.982216 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7998875bf8-rwkhz"] Jul 02 21:22:48.003441 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.003399 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7998875bf8-rwkhz" podUID="b345fcf2-f88e-496b-9413-52efc8326fe6" containerName="console" containerID="cri-o://f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704" gracePeriod=15 Jul 02 21:22:48.251323 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.251293 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:22:48.304124 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304099 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-service-ca\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304150 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-trusted-ca-bundle\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304188 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-serving-cert\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304215 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-console-config\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304286 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304242 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-oauth-config\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304517 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304289 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-oauth-serving-cert\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304517 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304375 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-758rq\" (UniqueName: \"kubernetes.io/projected/b345fcf2-f88e-496b-9413-52efc8326fe6-kube-api-access-758rq\") pod \"b345fcf2-f88e-496b-9413-52efc8326fe6\" (UID: \"b345fcf2-f88e-496b-9413-52efc8326fe6\") " Jul 02 21:22:48.304712 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304535 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-service-ca" (OuterVolumeSpecName: "service-ca") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:22:48.304796 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304762 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:22:48.304851 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304793 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-console-config" (OuterVolumeSpecName: "console-config") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:22:48.304851 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.304836 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:22:48.306851 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.306827 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b345fcf2-f88e-496b-9413-52efc8326fe6-kube-api-access-758rq" (OuterVolumeSpecName: "kube-api-access-758rq") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "kube-api-access-758rq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:22:48.307075 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.307055 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:22:48.307131 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.307079 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b345fcf2-f88e-496b-9413-52efc8326fe6" (UID: "b345fcf2-f88e-496b-9413-52efc8326fe6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:22:48.378655 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.378613 2550 generic.go:356] "Generic (PLEG): container finished" podID="b345fcf2-f88e-496b-9413-52efc8326fe6" containerID="f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704" exitCode=0 Jul 02 21:22:48.378655 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.378657 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7998875bf8-rwkhz" Jul 02 21:22:48.378891 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.378704 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7998875bf8-rwkhz" event={"ID":"b345fcf2-f88e-496b-9413-52efc8326fe6","Type":"ContainerDied","Data":"f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704"} Jul 02 21:22:48.378891 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.378760 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7998875bf8-rwkhz" event={"ID":"b345fcf2-f88e-496b-9413-52efc8326fe6","Type":"ContainerDied","Data":"b973561345800d8b40d0b4dc4490e81954f594dbdd6cf9b75f9a1f73adecd6a8"} Jul 02 21:22:48.378891 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.378782 2550 scope.go:117] "RemoveContainer" containerID="f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704" Jul 02 21:22:48.393812 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.393787 2550 scope.go:117] "RemoveContainer" containerID="f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704" Jul 02 21:22:48.394141 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:22:48.394116 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704\": container with ID starting with f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704 not found: ID does not exist" containerID="f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704" Jul 02 21:22:48.394210 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.394153 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704"} err="failed to get container status \"f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704\": rpc error: code = NotFound desc = could not find container \"f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704\": container with ID starting with f8a77df4c4e51c9f1a20fe371bcfcbcf9daa84ba51bf08c4fc0167f16994e704 not found: ID does not exist" Jul 02 21:22:48.404720 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.404682 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7998875bf8-rwkhz"] Jul 02 21:22:48.405065 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405047 2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-oauth-serving-cert\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.405105 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405068 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-758rq\" (UniqueName: \"kubernetes.io/projected/b345fcf2-f88e-496b-9413-52efc8326fe6-kube-api-access-758rq\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.405105 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405079 2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-service-ca\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.405105 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405087 2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-trusted-ca-bundle\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.405105 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405096 2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-serving-cert\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.405105 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405104 2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345fcf2-f88e-496b-9413-52efc8326fe6-console-config\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.405248 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.405112 2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345fcf2-f88e-496b-9413-52efc8326fe6-console-oauth-config\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 02 21:22:48.408873 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:48.408848 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7998875bf8-rwkhz"] Jul 02 21:22:50.296361 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:22:50.296324 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b345fcf2-f88e-496b-9413-52efc8326fe6" path="/var/lib/kubelet/pods/b345fcf2-f88e-496b-9413-52efc8326fe6/volumes" Jul 02 21:24:04.155429 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:04.155400 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:24:04.157728 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:04.157702 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:24:04.162047 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:04.162018 2550 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 21:24:14.557971 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.557941 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-8bftz"] Jul 02 21:24:14.560156 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.558256 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b345fcf2-f88e-496b-9413-52efc8326fe6" containerName="console" Jul 02 21:24:14.560156 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.558267 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b345fcf2-f88e-496b-9413-52efc8326fe6" containerName="console" Jul 02 21:24:14.560156 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.558332 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b345fcf2-f88e-496b-9413-52efc8326fe6" containerName="console" Jul 02 21:24:14.560973 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.560952 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.564539 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.564521 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 02 21:24:14.564799 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.564783 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 02 21:24:14.565199 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.565176 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 02 21:24:14.565303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.565217 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 02 21:24:14.565303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.565235 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-ngqw6\"" Jul 02 21:24:14.565303 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.565235 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 02 21:24:14.577798 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.577776 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-8bftz"] Jul 02 21:24:14.690831 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.690799 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.690981 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.690863 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsvh8\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-kube-api-access-vsvh8\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.690981 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.690888 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4168d2c4-099a-45ad-b431-161950e5690e-cabundle0\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.792084 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.792053 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.792238 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.792123 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsvh8\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-kube-api-access-vsvh8\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.792238 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.792151 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4168d2c4-099a-45ad-b431-161950e5690e-cabundle0\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.792331 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:14.792229 2550 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 02 21:24:14.792331 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:14.792255 2550 secret.go:281] references non-existent secret key: ca.crt Jul 02 21:24:14.792331 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:14.792267 2550 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 02 21:24:14.792331 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:14.792283 2550 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-8bftz: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 02 21:24:14.792484 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:14.792385 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates podName:4168d2c4-099a-45ad-b431-161950e5690e nodeName:}" failed. No retries permitted until 2026-07-02 21:24:15.292366274 +0000 UTC m=+311.593160700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates") pod "keda-operator-68bff59c-8bftz" (UID: "4168d2c4-099a-45ad-b431-161950e5690e") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 02 21:24:14.792780 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.792763 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4168d2c4-099a-45ad-b431-161950e5690e-cabundle0\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.800860 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.800828 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsvh8\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-kube-api-access-vsvh8\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:14.982378 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.982284 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq"] Jul 02 21:24:14.985536 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.985521 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:14.988012 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.987992 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 02 21:24:14.995700 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:14.995679 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq"] Jul 02 21:24:15.093929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.093890 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/fdd2c821-2afc-4d2e-a247-54c32e757180-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.093929 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.093931 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-certificates\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.094134 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.093973 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9vsl\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-kube-api-access-k9vsl\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.195224 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.195190 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/fdd2c821-2afc-4d2e-a247-54c32e757180-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.195388 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.195232 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-certificates\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.195388 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.195283 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9vsl\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-kube-api-access-k9vsl\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.195540 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.195523 2550 secret.go:281] references non-existent secret key: tls.crt Jul 02 21:24:15.195577 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.195544 2550 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 02 21:24:15.195577 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.195562 2550 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq: references non-existent secret key: tls.crt Jul 02 21:24:15.195641 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.195628 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-certificates podName:fdd2c821-2afc-4d2e-a247-54c32e757180 nodeName:}" failed. No retries permitted until 2026-07-02 21:24:15.695612958 +0000 UTC m=+311.996407365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-certificates") pod "keda-metrics-apiserver-559f75f947-8jkzq" (UID: "fdd2c821-2afc-4d2e-a247-54c32e757180") : references non-existent secret key: tls.crt Jul 02 21:24:15.195684 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.195653 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/fdd2c821-2afc-4d2e-a247-54c32e757180-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.205822 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.205800 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9vsl\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-kube-api-access-k9vsl\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.296353 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.296240 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:15.296501 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.296411 2550 secret.go:281] references non-existent secret key: ca.crt Jul 02 21:24:15.296501 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.296433 2550 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 02 21:24:15.296501 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.296442 2550 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-8bftz: references non-existent secret key: ca.crt Jul 02 21:24:15.296501 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:24:15.296497 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates podName:4168d2c4-099a-45ad-b431-161950e5690e nodeName:}" failed. No retries permitted until 2026-07-02 21:24:16.29648249 +0000 UTC m=+312.597276896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates") pod "keda-operator-68bff59c-8bftz" (UID: "4168d2c4-099a-45ad-b431-161950e5690e") : references non-existent secret key: ca.crt Jul 02 21:24:15.647454 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.647413 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-dgtf4"] Jul 02 21:24:15.650643 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.650628 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.653089 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.653069 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 02 21:24:15.663038 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.663018 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-dgtf4"] Jul 02 21:24:15.699901 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.699875 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-certificates\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.702597 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.702573 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdd2c821-2afc-4d2e-a247-54c32e757180-certificates\") pod \"keda-metrics-apiserver-559f75f947-8jkzq\" (UID: \"fdd2c821-2afc-4d2e-a247-54c32e757180\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.801207 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.801170 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df4346f7-62d0-4293-950e-03eecae3e940-certificates\") pod \"keda-admission-5fbd5c4644-dgtf4\" (UID: \"df4346f7-62d0-4293-950e-03eecae3e940\") " pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.801403 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.801280 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svzxj\" (UniqueName: \"kubernetes.io/projected/df4346f7-62d0-4293-950e-03eecae3e940-kube-api-access-svzxj\") pod \"keda-admission-5fbd5c4644-dgtf4\" (UID: \"df4346f7-62d0-4293-950e-03eecae3e940\") " pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.896008 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.895971 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:15.902388 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.902357 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df4346f7-62d0-4293-950e-03eecae3e940-certificates\") pod \"keda-admission-5fbd5c4644-dgtf4\" (UID: \"df4346f7-62d0-4293-950e-03eecae3e940\") " pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.902503 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.902453 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzxj\" (UniqueName: \"kubernetes.io/projected/df4346f7-62d0-4293-950e-03eecae3e940-kube-api-access-svzxj\") pod \"keda-admission-5fbd5c4644-dgtf4\" (UID: \"df4346f7-62d0-4293-950e-03eecae3e940\") " pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.905098 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.905076 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df4346f7-62d0-4293-950e-03eecae3e940-certificates\") pod \"keda-admission-5fbd5c4644-dgtf4\" (UID: \"df4346f7-62d0-4293-950e-03eecae3e940\") " pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.911550 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.911520 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svzxj\" (UniqueName: \"kubernetes.io/projected/df4346f7-62d0-4293-950e-03eecae3e940-kube-api-access-svzxj\") pod \"keda-admission-5fbd5c4644-dgtf4\" (UID: \"df4346f7-62d0-4293-950e-03eecae3e940\") " pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:15.960713 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:15.960685 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:16.065737 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.065701 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq"] Jul 02 21:24:16.075196 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.075172 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:24:16.128259 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.128227 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-dgtf4"] Jul 02 21:24:16.132569 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:24:16.132542 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4346f7_62d0_4293_950e_03eecae3e940.slice/crio-3d7b799b6c21ea3b53b5ac0a97dad8aae9e622d5a8173794b5d3bae01ca8b18a WatchSource:0}: Error finding container 3d7b799b6c21ea3b53b5ac0a97dad8aae9e622d5a8173794b5d3bae01ca8b18a: Status 404 returned error can't find the container with id 3d7b799b6c21ea3b53b5ac0a97dad8aae9e622d5a8173794b5d3bae01ca8b18a Jul 02 21:24:16.306721 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.306697 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:16.309156 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.309129 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4168d2c4-099a-45ad-b431-161950e5690e-certificates\") pod \"keda-operator-68bff59c-8bftz\" (UID: \"4168d2c4-099a-45ad-b431-161950e5690e\") " pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:16.371449 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.371420 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:16.506428 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.506400 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-8bftz"] Jul 02 21:24:16.509742 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:24:16.509718 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4168d2c4_099a_45ad_b431_161950e5690e.slice/crio-f2b8dda7aa6b0996d0f77db0b2ab5a3400592534e1189e427c70774902efd028 WatchSource:0}: Error finding container f2b8dda7aa6b0996d0f77db0b2ab5a3400592534e1189e427c70774902efd028: Status 404 returned error can't find the container with id f2b8dda7aa6b0996d0f77db0b2ab5a3400592534e1189e427c70774902efd028 Jul 02 21:24:16.716086 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.715956 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" event={"ID":"df4346f7-62d0-4293-950e-03eecae3e940","Type":"ContainerStarted","Data":"3d7b799b6c21ea3b53b5ac0a97dad8aae9e622d5a8173794b5d3bae01ca8b18a"} Jul 02 21:24:16.717564 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.717531 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-8bftz" event={"ID":"4168d2c4-099a-45ad-b431-161950e5690e","Type":"ContainerStarted","Data":"f2b8dda7aa6b0996d0f77db0b2ab5a3400592534e1189e427c70774902efd028"} Jul 02 21:24:16.719180 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:16.719157 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" event={"ID":"fdd2c821-2afc-4d2e-a247-54c32e757180","Type":"ContainerStarted","Data":"3e941535384b168a2ef75db96502e0028dc950afbb62fbff95380a7dbdee47e4"} Jul 02 21:24:21.747086 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.747043 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" event={"ID":"df4346f7-62d0-4293-950e-03eecae3e940","Type":"ContainerStarted","Data":"8807467c3043201d417f18cbc8803c9164f29c355ecd4f16edde250911f3c984"} Jul 02 21:24:21.747573 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.747134 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:24:21.748605 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.748578 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-8bftz" event={"ID":"4168d2c4-099a-45ad-b431-161950e5690e","Type":"ContainerStarted","Data":"af83a1bbc7e0179aafc1b236458ee06d27942ab871a68a0fe000369a69c09111"} Jul 02 21:24:21.748735 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.748622 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:21.749958 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.749933 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" event={"ID":"fdd2c821-2afc-4d2e-a247-54c32e757180","Type":"ContainerStarted","Data":"a7dda05c9411131b700fc0f69fc8b8bdaed26305f8b588b58df614f947bb0bf0"} Jul 02 21:24:21.750065 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.749983 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:21.764901 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.764855 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" podStartSLOduration=1.8748740270000002 podStartE2EDuration="6.764844447s" totalImagesPullingTime="4.88997042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:24:21.764168684 +0000 UTC m=+318.064963124" watchObservedRunningTime="2026-07-02 21:24:21.764844447 +0000 UTC m=+318.065638876" Jul 02 21:24:21.782163 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.782116 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" podStartSLOduration=2.837172174 podStartE2EDuration="7.782103417s" totalImagesPullingTime="4.944931243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:24:21.780864972 +0000 UTC m=+318.081659401" watchObservedRunningTime="2026-07-02 21:24:21.782103417 +0000 UTC m=+318.082897846" Jul 02 21:24:21.800408 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:21.800373 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-8bftz" podStartSLOduration=3.274033298 podStartE2EDuration="7.8003607s" totalImagesPullingTime="4.526327402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:24:21.798872115 +0000 UTC m=+318.099666543" watchObservedRunningTime="2026-07-02 21:24:21.8003607 +0000 UTC m=+318.101155129" Jul 02 21:24:32.761863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:32.761834 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8jkzq" Jul 02 21:24:42.758784 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:42.758750 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-8bftz" Jul 02 21:24:42.759425 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:24:42.759407 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-dgtf4" Jul 02 21:25:23.780368 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.780332 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-5dhdl"] Jul 02 21:25:23.782692 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.782676 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:23.787012 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.786986 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-sx7n8\"" Jul 02 21:25:23.787128 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.787052 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 02 21:25:23.787390 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.787369 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 21:25:23.787390 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.787388 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 21:25:23.796244 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.796222 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-5dhdl"] Jul 02 21:25:23.863493 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.863465 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6f55722-303d-4a43-89b0-d3563a4bc769-data\") pod \"seaweedfs-64568bcd49-5dhdl\" (UID: \"f6f55722-303d-4a43-89b0-d3563a4bc769\") " pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:23.863613 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.863562 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6dgn\" (UniqueName: \"kubernetes.io/projected/f6f55722-303d-4a43-89b0-d3563a4bc769-kube-api-access-g6dgn\") pod \"seaweedfs-64568bcd49-5dhdl\" (UID: \"f6f55722-303d-4a43-89b0-d3563a4bc769\") " pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:23.964054 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.964020 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6dgn\" (UniqueName: \"kubernetes.io/projected/f6f55722-303d-4a43-89b0-d3563a4bc769-kube-api-access-g6dgn\") pod \"seaweedfs-64568bcd49-5dhdl\" (UID: \"f6f55722-303d-4a43-89b0-d3563a4bc769\") " pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:23.964127 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.964076 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6f55722-303d-4a43-89b0-d3563a4bc769-data\") pod \"seaweedfs-64568bcd49-5dhdl\" (UID: \"f6f55722-303d-4a43-89b0-d3563a4bc769\") " pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:23.964469 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.964451 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6f55722-303d-4a43-89b0-d3563a4bc769-data\") pod \"seaweedfs-64568bcd49-5dhdl\" (UID: \"f6f55722-303d-4a43-89b0-d3563a4bc769\") " pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:23.974716 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:23.974695 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6dgn\" (UniqueName: \"kubernetes.io/projected/f6f55722-303d-4a43-89b0-d3563a4bc769-kube-api-access-g6dgn\") pod \"seaweedfs-64568bcd49-5dhdl\" (UID: \"f6f55722-303d-4a43-89b0-d3563a4bc769\") " pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:24.092239 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:24.092215 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:24.218061 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:24.218033 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-5dhdl"] Jul 02 21:25:24.221154 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:25:24.221127 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f55722_303d_4a43_89b0_d3563a4bc769.slice/crio-1e3fa12da085c5b981530641cf3f70e409f636d59021297ae8f92e2314f184e7 WatchSource:0}: Error finding container 1e3fa12da085c5b981530641cf3f70e409f636d59021297ae8f92e2314f184e7: Status 404 returned error can't find the container with id 1e3fa12da085c5b981530641cf3f70e409f636d59021297ae8f92e2314f184e7 Jul 02 21:25:25.004265 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:25.004232 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-5dhdl" event={"ID":"f6f55722-303d-4a43-89b0-d3563a4bc769","Type":"ContainerStarted","Data":"1e3fa12da085c5b981530641cf3f70e409f636d59021297ae8f92e2314f184e7"} Jul 02 21:25:28.021546 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:28.021505 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-5dhdl" event={"ID":"f6f55722-303d-4a43-89b0-d3563a4bc769","Type":"ContainerStarted","Data":"182f46251c1fc77a44d1978cbc1b587e9feced3dea274c6b05975141a96aa3a0"} Jul 02 21:25:28.021922 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:28.021594 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:25:28.042620 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:28.042571 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-5dhdl" podStartSLOduration=1.857154237 podStartE2EDuration="5.042556744s" totalImagesPullingTime="3.185402507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:25:28.041721686 +0000 UTC m=+384.342516126" watchObservedRunningTime="2026-07-02 21:25:28.042556744 +0000 UTC m=+384.343351173" Jul 02 21:25:34.028734 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:25:34.028704 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-5dhdl" Jul 02 21:26:04.464007 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.463972 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d89f5b7f-6kk2q"] Jul 02 21:26:04.467638 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.467617 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.470890 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.470867 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 21:26:04.471018 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.470868 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 21:26:04.471798 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.471780 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 21:26:04.471909 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.471890 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 21:26:04.472007 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.471987 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 21:26:04.472230 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.472117 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 21:26:04.472230 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.472155 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ptcsr\"" Jul 02 21:26:04.473002 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.472986 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 21:26:04.478406 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.478387 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 21:26:04.489609 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.489583 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d89f5b7f-6kk2q"] Jul 02 21:26:04.597673 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597633 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-oauth-config\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.597673 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597671 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-trusted-ca-bundle\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.597925 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597821 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-service-ca\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.597925 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597865 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-serving-cert\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.597925 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597895 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-config\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.597925 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597920 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlr4\" (UniqueName: \"kubernetes.io/projected/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-kube-api-access-9xlr4\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.598078 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.597950 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-oauth-serving-cert\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699210 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699164 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-serving-cert\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699210 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699211 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-config\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699533 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699237 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlr4\" (UniqueName: \"kubernetes.io/projected/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-kube-api-access-9xlr4\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699533 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699262 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-oauth-serving-cert\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699533 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699299 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-oauth-config\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699533 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699458 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-trusted-ca-bundle\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.699764 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699586 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-service-ca\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.700007 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699924 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-config\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.700261 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.699978 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-oauth-serving-cert\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.700261 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.700210 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-service-ca\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.700406 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.700367 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-trusted-ca-bundle\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.701742 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.701715 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-serving-cert\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.701865 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.701846 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-console-oauth-config\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.707853 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.707834 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlr4\" (UniqueName: \"kubernetes.io/projected/e88309cb-0f3a-47b1-80a0-7998f1dc49ef-kube-api-access-9xlr4\") pod \"console-65d89f5b7f-6kk2q\" (UID: \"e88309cb-0f3a-47b1-80a0-7998f1dc49ef\") " pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.778588 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.778499 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:04.911181 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:04.911148 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d89f5b7f-6kk2q"] Jul 02 21:26:04.914208 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:26:04.914177 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88309cb_0f3a_47b1_80a0_7998f1dc49ef.slice/crio-6d4a1e88666071f3c09df703288f6d946144eb44488762c4e418d95d73025afa WatchSource:0}: Error finding container 6d4a1e88666071f3c09df703288f6d946144eb44488762c4e418d95d73025afa: Status 404 returned error can't find the container with id 6d4a1e88666071f3c09df703288f6d946144eb44488762c4e418d95d73025afa Jul 02 21:26:05.172089 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:05.172043 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d89f5b7f-6kk2q" event={"ID":"e88309cb-0f3a-47b1-80a0-7998f1dc49ef","Type":"ContainerStarted","Data":"3a7f3bfab4fb905f8001ac84b8a9f9e85e873ebae7108ae20a6b9c12d0c72e34"} Jul 02 21:26:05.172270 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:05.172102 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d89f5b7f-6kk2q" event={"ID":"e88309cb-0f3a-47b1-80a0-7998f1dc49ef","Type":"ContainerStarted","Data":"6d4a1e88666071f3c09df703288f6d946144eb44488762c4e418d95d73025afa"} Jul 02 21:26:05.192413 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:05.192353 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d89f5b7f-6kk2q" podStartSLOduration=1.192335066 podStartE2EDuration="1.192335066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:26:05.192271895 +0000 UTC m=+421.493066327" watchObservedRunningTime="2026-07-02 21:26:05.192335066 +0000 UTC m=+421.493129492" Jul 02 21:26:14.779186 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:14.779143 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:14.779600 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:14.779207 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:14.784771 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:14.784749 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:15.223463 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:15.223426 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d89f5b7f-6kk2q" Jul 02 21:26:34.973644 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:34.973567 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-ql5ts"] Jul 02 21:26:34.976860 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:34.976844 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:34.979801 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:34.979777 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-n6hdh\"" Jul 02 21:26:34.981102 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:34.981086 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 02 21:26:34.993134 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:34.993114 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ql5ts"] Jul 02 21:26:35.056384 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.056353 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1662b4fc-c0b4-4721-84ba-5e66d8bb320b-tls-certs\") pod \"model-serving-api-fd65d7d6-ql5ts\" (UID: \"1662b4fc-c0b4-4721-84ba-5e66d8bb320b\") " pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.056534 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.056407 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkms\" (UniqueName: \"kubernetes.io/projected/1662b4fc-c0b4-4721-84ba-5e66d8bb320b-kube-api-access-qhkms\") pod \"model-serving-api-fd65d7d6-ql5ts\" (UID: \"1662b4fc-c0b4-4721-84ba-5e66d8bb320b\") " pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.156995 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.156953 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkms\" (UniqueName: \"kubernetes.io/projected/1662b4fc-c0b4-4721-84ba-5e66d8bb320b-kube-api-access-qhkms\") pod \"model-serving-api-fd65d7d6-ql5ts\" (UID: \"1662b4fc-c0b4-4721-84ba-5e66d8bb320b\") " pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.157168 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.157075 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1662b4fc-c0b4-4721-84ba-5e66d8bb320b-tls-certs\") pod \"model-serving-api-fd65d7d6-ql5ts\" (UID: \"1662b4fc-c0b4-4721-84ba-5e66d8bb320b\") " pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.159749 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.159729 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1662b4fc-c0b4-4721-84ba-5e66d8bb320b-tls-certs\") pod \"model-serving-api-fd65d7d6-ql5ts\" (UID: \"1662b4fc-c0b4-4721-84ba-5e66d8bb320b\") " pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.168016 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.167983 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkms\" (UniqueName: \"kubernetes.io/projected/1662b4fc-c0b4-4721-84ba-5e66d8bb320b-kube-api-access-qhkms\") pod \"model-serving-api-fd65d7d6-ql5ts\" (UID: \"1662b4fc-c0b4-4721-84ba-5e66d8bb320b\") " pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.287775 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.287682 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:35.419075 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:35.419047 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ql5ts"] Jul 02 21:26:35.421556 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:26:35.421526 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1662b4fc_c0b4_4721_84ba_5e66d8bb320b.slice/crio-c13925792dbb0dfe2bde2649db724165a682a5fee96118f39c6f9983d5697952 WatchSource:0}: Error finding container c13925792dbb0dfe2bde2649db724165a682a5fee96118f39c6f9983d5697952: Status 404 returned error can't find the container with id c13925792dbb0dfe2bde2649db724165a682a5fee96118f39c6f9983d5697952 Jul 02 21:26:36.306072 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:36.306033 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ql5ts" event={"ID":"1662b4fc-c0b4-4721-84ba-5e66d8bb320b","Type":"ContainerStarted","Data":"c13925792dbb0dfe2bde2649db724165a682a5fee96118f39c6f9983d5697952"} Jul 02 21:26:38.317244 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:38.317210 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ql5ts" event={"ID":"1662b4fc-c0b4-4721-84ba-5e66d8bb320b","Type":"ContainerStarted","Data":"8418752d3c84ac5820aea1c493b0bbfb18c88720d0e1ca8251a9b105efb52302"} Jul 02 21:26:38.317642 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:38.317282 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:26:38.334298 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:38.334250 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-ql5ts" podStartSLOduration=2.003867362 podStartE2EDuration="4.334234742s" totalImagesPullingTime="2.33036738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:26:38.333201825 +0000 UTC m=+454.633996253" watchObservedRunningTime="2026-07-02 21:26:38.334234742 +0000 UTC m=+454.635029172" Jul 02 21:26:49.325565 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:26:49.325530 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-ql5ts" Jul 02 21:28:19.477366 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.477330 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-w67mm"] Jul 02 21:28:19.480814 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.480797 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.483607 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.483586 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 02 21:28:19.484129 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.484115 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 02 21:28:19.491458 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.491432 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-w67mm"] Jul 02 21:28:19.541213 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.541173 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d1807da-d7b9-4c5f-946e-faadbafe1785-data\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.541422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.541224 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/2d1807da-d7b9-4c5f-946e-faadbafe1785-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.541422 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.541298 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k2sx\" (UniqueName: \"kubernetes.io/projected/2d1807da-d7b9-4c5f-946e-faadbafe1785-kube-api-access-7k2sx\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.641991 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.641946 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d1807da-d7b9-4c5f-946e-faadbafe1785-data\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.642183 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.642013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/2d1807da-d7b9-4c5f-946e-faadbafe1785-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.642183 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.642063 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2sx\" (UniqueName: \"kubernetes.io/projected/2d1807da-d7b9-4c5f-946e-faadbafe1785-kube-api-access-7k2sx\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.642403 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.642381 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d1807da-d7b9-4c5f-946e-faadbafe1785-data\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.644595 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.644576 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/2d1807da-d7b9-4c5f-946e-faadbafe1785-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.660468 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.660434 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k2sx\" (UniqueName: \"kubernetes.io/projected/2d1807da-d7b9-4c5f-946e-faadbafe1785-kube-api-access-7k2sx\") pod \"seaweedfs-tls-custom-8b44d767d-w67mm\" (UID: \"2d1807da-d7b9-4c5f-946e-faadbafe1785\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.790362 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.790256 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" Jul 02 21:28:19.931978 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:19.931949 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-w67mm"] Jul 02 21:28:19.934516 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:28:19.934490 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1807da_d7b9_4c5f_946e_faadbafe1785.slice/crio-6e5eccd7183be35dc3e14ef751cd55182741b06af1506fa3d14c759b016b439b WatchSource:0}: Error finding container 6e5eccd7183be35dc3e14ef751cd55182741b06af1506fa3d14c759b016b439b: Status 404 returned error can't find the container with id 6e5eccd7183be35dc3e14ef751cd55182741b06af1506fa3d14c759b016b439b Jul 02 21:28:20.748404 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:20.748364 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" event={"ID":"2d1807da-d7b9-4c5f-946e-faadbafe1785","Type":"ContainerStarted","Data":"fc11b966b5390eb24a9368c509f3947ebf25dd315d9240c2712b7043f884e896"} Jul 02 21:28:20.748812 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:20.748416 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" event={"ID":"2d1807da-d7b9-4c5f-946e-faadbafe1785","Type":"ContainerStarted","Data":"6e5eccd7183be35dc3e14ef751cd55182741b06af1506fa3d14c759b016b439b"} Jul 02 21:28:20.764372 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:20.764299 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-w67mm" podStartSLOduration=1.491153675 podStartE2EDuration="1.764283876s" totalImagesPullingTime="273.130201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:28:20.763347308 +0000 UTC m=+557.064141739" watchObservedRunningTime="2026-07-02 21:28:20.764283876 +0000 UTC m=+557.065078306" Jul 02 21:28:36.105943 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.105907 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-22fkn"] Jul 02 21:28:36.109400 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.109383 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.112270 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.112253 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 02 21:28:36.112367 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.112349 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 02 21:28:36.118191 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.118164 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-22fkn"] Jul 02 21:28:36.182786 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.182753 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.182786 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.182789 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b59af1fc-19ac-4767-b087-6f5161a71cc9-data\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.182995 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.182815 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdj4c\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-kube-api-access-rdj4c\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.284114 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.284073 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.284114 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.284110 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b59af1fc-19ac-4767-b087-6f5161a71cc9-data\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.284346 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.284152 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdj4c\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-kube-api-access-rdj4c\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.284346 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:28:36.284224 2550 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 02 21:28:36.284346 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:28:36.284243 2550 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-22fkn: secret "seaweedfs-tls-serving" not found Jul 02 21:28:36.284443 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:28:36.284350 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving podName:b59af1fc-19ac-4767-b087-6f5161a71cc9 nodeName:}" failed. No retries permitted until 2026-07-02 21:28:36.784301464 +0000 UTC m=+573.085095871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-22fkn" (UID: "b59af1fc-19ac-4767-b087-6f5161a71cc9") : secret "seaweedfs-tls-serving" not found Jul 02 21:28:36.284636 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.284616 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b59af1fc-19ac-4767-b087-6f5161a71cc9-data\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.293472 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.293449 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdj4c\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-kube-api-access-rdj4c\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.789378 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:36.789334 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:36.789568 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:28:36.789493 2550 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 02 21:28:36.789568 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:28:36.789515 2550 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-22fkn: secret "seaweedfs-tls-serving" not found Jul 02 21:28:36.789661 ip-10-0-141-123 kubenswrapper[2550]: E0702 21:28:36.789581 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving podName:b59af1fc-19ac-4767-b087-6f5161a71cc9 nodeName:}" failed. No retries permitted until 2026-07-02 21:28:37.789566435 +0000 UTC m=+574.090360847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-22fkn" (UID: "b59af1fc-19ac-4767-b087-6f5161a71cc9") : secret "seaweedfs-tls-serving" not found Jul 02 21:28:37.797661 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:37.797623 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:37.800193 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:37.800170 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/b59af1fc-19ac-4767-b087-6f5161a71cc9-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-22fkn\" (UID: \"b59af1fc-19ac-4767-b087-6f5161a71cc9\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:37.919909 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:37.919857 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" Jul 02 21:28:38.053670 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:38.053641 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-22fkn"] Jul 02 21:28:38.056965 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:28:38.056938 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59af1fc_19ac_4767_b087_6f5161a71cc9.slice/crio-b24949e52d51665d70f8bc1a7156fe01306c1e46933284d2aea9ce1d5a5359d9 WatchSource:0}: Error finding container b24949e52d51665d70f8bc1a7156fe01306c1e46933284d2aea9ce1d5a5359d9: Status 404 returned error can't find the container with id b24949e52d51665d70f8bc1a7156fe01306c1e46933284d2aea9ce1d5a5359d9 Jul 02 21:28:38.835425 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:38.835381 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" event={"ID":"b59af1fc-19ac-4767-b087-6f5161a71cc9","Type":"ContainerStarted","Data":"ef99fb16ff4d0ba96131a37602f713d0f350e2e899f232ddc2c9e7bbd1ace2eb"} Jul 02 21:28:38.835823 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:38.835452 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" event={"ID":"b59af1fc-19ac-4767-b087-6f5161a71cc9","Type":"ContainerStarted","Data":"b24949e52d51665d70f8bc1a7156fe01306c1e46933284d2aea9ce1d5a5359d9"} Jul 02 21:28:38.851847 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:28:38.851794 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-22fkn" podStartSLOduration=2.612614461 podStartE2EDuration="2.851776167s" totalImagesPullingTime="239.161706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:28:38.850392642 +0000 UTC m=+575.151187073" watchObservedRunningTime="2026-07-02 21:28:38.851776167 +0000 UTC m=+575.152570595" Jul 02 21:29:04.184834 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:29:04.184791 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:29:04.185389 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:29:04.184950 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:34:04.214234 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:34:04.214162 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:34:04.214234 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:34:04.214217 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:39:04.242639 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:39:04.242602 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:39:04.243155 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:39:04.242918 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:44:04.271605 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:44:04.271574 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:44:04.274215 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:44:04.272026 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:45:16.547094 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:16.547064 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mjbss_e34ed7b7-7ec0-465a-b36e-b5520d643fc4/global-pull-secret-syncer/0.log" Jul 02 21:45:16.634706 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:16.634680 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mt8fl_af685e79-0650-4c3d-86d4-6e58de7130af/konnectivity-agent/0.log" Jul 02 21:45:16.736889 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:16.736859 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-123.ec2.internal_bc8b346ff26bd2da637db45021bfde3d/haproxy/0.log" Jul 02 21:45:20.300033 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.300008 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/alertmanager/0.log" Jul 02 21:45:20.328194 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.328173 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/config-reloader/0.log" Jul 02 21:45:20.357224 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.357202 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/kube-rbac-proxy-web/0.log" Jul 02 21:45:20.394133 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.394111 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/kube-rbac-proxy/0.log" Jul 02 21:45:20.421443 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.421416 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/kube-rbac-proxy-metric/0.log" Jul 02 21:45:20.454017 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.453987 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/prom-label-proxy/0.log" Jul 02 21:45:20.485443 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.485417 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd98af81-4865-47ea-817e-f6aa8ccb0fae/init-config-reloader/0.log" Jul 02 21:45:20.526085 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.526057 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-bxkfm_6d3755ce-b5be-409a-ba9d-7e96dd99c5bb/cluster-monitoring-operator/0.log" Jul 02 21:45:20.752036 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.752008 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-crn6s_2e9234b1-5dba-4646-8a6f-6bffca0bc24e/node-exporter/0.log" Jul 02 21:45:20.780101 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.780074 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-crn6s_2e9234b1-5dba-4646-8a6f-6bffca0bc24e/kube-rbac-proxy/0.log" Jul 02 21:45:20.810091 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:20.810063 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-crn6s_2e9234b1-5dba-4646-8a6f-6bffca0bc24e/init-textfile/0.log" Jul 02 21:45:21.040109 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.040035 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8g9lg_44ae0207-6f6a-445f-8a18-47b69a3dd6f8/kube-rbac-proxy-main/0.log" Jul 02 21:45:21.069507 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.069477 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8g9lg_44ae0207-6f6a-445f-8a18-47b69a3dd6f8/kube-rbac-proxy-self/0.log" Jul 02 21:45:21.102998 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.102975 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8g9lg_44ae0207-6f6a-445f-8a18-47b69a3dd6f8/openshift-state-metrics/0.log" Jul 02 21:45:21.405933 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.405906 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-wblsf_3b51635b-0376-490b-8d25-c888231660bd/prometheus-operator/0.log" Jul 02 21:45:21.427306 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.427281 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-wblsf_3b51635b-0376-490b-8d25-c888231660bd/kube-rbac-proxy/0.log" Jul 02 21:45:21.460384 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.460363 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-t5x57_d239fb89-4c49-41f9-9789-1a5ee354dd26/prometheus-operator-admission-webhook/0.log" Jul 02 21:45:21.502952 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.502931 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c74dfb84f-bcpvl_e370cff6-1234-4eb0-a391-d2410f4c5752/telemeter-client/0.log" Jul 02 21:45:21.529507 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.529483 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c74dfb84f-bcpvl_e370cff6-1234-4eb0-a391-d2410f4c5752/reload/0.log" Jul 02 21:45:21.556032 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.556011 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c74dfb84f-bcpvl_e370cff6-1234-4eb0-a391-d2410f4c5752/kube-rbac-proxy/0.log" Jul 02 21:45:21.595219 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.595196 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bbcb7bc8-rs64q_12ef60bd-ca45-4af2-a35e-4d52516ec7fb/thanos-query/0.log" Jul 02 21:45:21.620452 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.620415 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bbcb7bc8-rs64q_12ef60bd-ca45-4af2-a35e-4d52516ec7fb/kube-rbac-proxy-web/0.log" Jul 02 21:45:21.648112 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.648088 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bbcb7bc8-rs64q_12ef60bd-ca45-4af2-a35e-4d52516ec7fb/kube-rbac-proxy/0.log" Jul 02 21:45:21.674029 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.673957 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bbcb7bc8-rs64q_12ef60bd-ca45-4af2-a35e-4d52516ec7fb/prom-label-proxy/0.log" Jul 02 21:45:21.699098 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.699078 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bbcb7bc8-rs64q_12ef60bd-ca45-4af2-a35e-4d52516ec7fb/kube-rbac-proxy-rules/0.log" Jul 02 21:45:21.721664 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:21.721640 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bbcb7bc8-rs64q_12ef60bd-ca45-4af2-a35e-4d52516ec7fb/kube-rbac-proxy-metrics/0.log" Jul 02 21:45:24.117148 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:24.117112 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65d89f5b7f-6kk2q_e88309cb-0f3a-47b1-80a0-7998f1dc49ef/console/0.log" Jul 02 21:45:25.578668 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.578644 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vxcx_0bcdcc4c-fc8d-47a8-9465-c6e331b54766/dns/0.log" Jul 02 21:45:25.600283 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.600252 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vxcx_0bcdcc4c-fc8d-47a8-9465-c6e331b54766/kube-rbac-proxy/0.log" Jul 02 21:45:25.648402 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.648375 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz"] Jul 02 21:45:25.651932 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.651914 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.654246 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.654221 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2hh8\"/\"openshift-service-ca.crt\"" Jul 02 21:45:25.655336 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.655301 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2hh8\"/\"kube-root-ca.crt\"" Jul 02 21:45:25.655405 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.655301 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2hh8\"/\"default-dockercfg-fjmss\"" Jul 02 21:45:25.664096 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.664050 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz"] Jul 02 21:45:25.751694 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.751664 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6x7pp_242246cb-b977-438a-8938-e1dc0cc58dcc/dns-node-resolver/0.log" Jul 02 21:45:25.799838 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.799810 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-podres\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.799953 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.799845 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chnwz\" (UniqueName: \"kubernetes.io/projected/7940128f-c6ed-447d-b7a3-3390f9c03d42-kube-api-access-chnwz\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.799953 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.799906 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-sys\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.799953 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.799931 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-lib-modules\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.800071 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.800028 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-proc\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900575 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900495 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-sys\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900575 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900533 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-lib-modules\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900580 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-proc\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900600 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-podres\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900619 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chnwz\" (UniqueName: \"kubernetes.io/projected/7940128f-c6ed-447d-b7a3-3390f9c03d42-kube-api-access-chnwz\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900634 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-sys\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900682 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-proc\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900766 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900757 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-podres\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.900952 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.900766 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7940128f-c6ed-447d-b7a3-3390f9c03d42-lib-modules\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.908246 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.908219 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chnwz\" (UniqueName: \"kubernetes.io/projected/7940128f-c6ed-447d-b7a3-3390f9c03d42-kube-api-access-chnwz\") pod \"perf-node-gather-daemonset-rbzsz\" (UID: \"7940128f-c6ed-447d-b7a3-3390f9c03d42\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:25.968959 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:25.968936 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:26.101126 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:26.101095 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz"] Jul 02 21:45:26.103420 ip-10-0-141-123 kubenswrapper[2550]: W0702 21:45:26.103393 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7940128f_c6ed_447d_b7a3_3390f9c03d42.slice/crio-2266d8748c54714a7d505e5b2ee11b6be15b62de07f4ad140aad21fd38fdd925 WatchSource:0}: Error finding container 2266d8748c54714a7d505e5b2ee11b6be15b62de07f4ad140aad21fd38fdd925: Status 404 returned error can't find the container with id 2266d8748c54714a7d505e5b2ee11b6be15b62de07f4ad140aad21fd38fdd925 Jul 02 21:45:26.365540 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:26.365500 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" event={"ID":"7940128f-c6ed-447d-b7a3-3390f9c03d42","Type":"ContainerStarted","Data":"dbcb9dc1367b382edc656e8134811cb923a3bd1d0baebf439e3766ebb42e3615"} Jul 02 21:45:26.365712 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:26.365552 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" event={"ID":"7940128f-c6ed-447d-b7a3-3390f9c03d42","Type":"ContainerStarted","Data":"2266d8748c54714a7d505e5b2ee11b6be15b62de07f4ad140aad21fd38fdd925"} Jul 02 21:45:26.365712 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:26.365581 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:26.405792 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:26.405742 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" podStartSLOduration=1.40572722 podStartE2EDuration="1.40572722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:26.404486054 +0000 UTC m=+1582.705280485" watchObservedRunningTime="2026-07-02 21:45:26.40572722 +0000 UTC m=+1582.706521648" Jul 02 21:45:26.487073 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:26.487013 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tbjmj_7f9eddaf-0240-4089-b8bc-f52721de7a56/node-ca/0.log" Jul 02 21:45:27.316531 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:27.316504 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69c64548d9-5wp72_9bf0a887-dedc-44ac-a3fb-ad6392975200/router/0.log" Jul 02 21:45:27.737307 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:27.737227 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-srm2w_dabb5f36-2206-455f-a785-d48f69bfef9f/serve-healthcheck-canary/0.log" Jul 02 21:45:28.209840 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:28.209799 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-5qf9s_818db894-96da-498c-8245-f8dd288601cc/insights-operator/0.log" Jul 02 21:45:28.210924 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:28.210900 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-5qf9s_818db894-96da-498c-8245-f8dd288601cc/insights-operator/1.log" Jul 02 21:45:28.300788 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:28.300752 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fkt9s_c5c05b14-d8e4-4781-9568-9f75605aeec7/kube-rbac-proxy/0.log" Jul 02 21:45:28.322700 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:28.322681 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fkt9s_c5c05b14-d8e4-4781-9568-9f75605aeec7/exporter/0.log" Jul 02 21:45:28.345949 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:28.345929 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fkt9s_c5c05b14-d8e4-4781-9568-9f75605aeec7/extractor/0.log" Jul 02 21:45:30.478460 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:30.478432 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-ql5ts_1662b4fc-c0b4-4721-84ba-5e66d8bb320b/server/0.log" Jul 02 21:45:30.748211 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:30.748139 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-5dhdl_f6f55722-303d-4a43-89b0-d3563a4bc769/seaweedfs/0.log" Jul 02 21:45:30.774863 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:30.774840 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-w67mm_2d1807da-d7b9-4c5f-946e-faadbafe1785/seaweedfs-tls-custom/0.log" Jul 02 21:45:30.804652 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:30.804624 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-22fkn_b59af1fc-19ac-4767-b087-6f5161a71cc9/seaweedfs-tls-serving/0.log" Jul 02 21:45:32.380502 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:32.380475 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-rbzsz" Jul 02 21:45:36.369360 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.369262 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/kube-multus-additional-cni-plugins/0.log" Jul 02 21:45:36.393091 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.393069 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/egress-router-binary-copy/0.log" Jul 02 21:45:36.418982 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.418957 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/cni-plugins/0.log" Jul 02 21:45:36.440808 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.440783 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/bond-cni-plugin/0.log" Jul 02 21:45:36.462874 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.462855 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/routeoverride-cni/0.log" Jul 02 21:45:36.486242 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.486223 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/whereabouts-cni-bincopy/0.log" Jul 02 21:45:36.508995 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.508976 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl924_8361d1d0-806c-44aa-ae93-d407ef71ed9c/whereabouts-cni/0.log" Jul 02 21:45:36.751903 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.751833 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qfr64_1cf80d24-1134-4f73-8de2-941f10b016c5/kube-multus/0.log" Jul 02 21:45:36.776711 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.776683 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vkrs_7d639562-6612-4749-aac9-93156846b5f3/network-metrics-daemon/0.log" Jul 02 21:45:36.799177 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:36.799140 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vkrs_7d639562-6612-4749-aac9-93156846b5f3/kube-rbac-proxy/0.log" Jul 02 21:45:37.622298 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.622260 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-controller/0.log" Jul 02 21:45:37.642222 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.642177 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/0.log" Jul 02 21:45:37.642378 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.642226 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovn-acl-logging/1.log" Jul 02 21:45:37.661041 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.661014 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/kube-rbac-proxy-node/0.log" Jul 02 21:45:37.682221 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.682199 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 21:45:37.715689 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.715664 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/northd/0.log" Jul 02 21:45:37.761933 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.761909 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/nbdb/0.log" Jul 02 21:45:37.809848 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.809827 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/sbdb/0.log" Jul 02 21:45:37.851737 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:37.851714 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28cz9_5f94cd18-f3ca-4aa0-b466-c742e8de725a/ovnkube-controller/0.log" Jul 02 21:45:39.323026 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:39.323001 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jsb68_fe001302-d790-4a79-b07f-63ff03496eda/network-check-target-container/0.log" Jul 02 21:45:40.261628 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:40.261596 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bbfk4_6450f7dc-20f7-4e45-98d2-2136829714f7/iptables-alerter/0.log" Jul 02 21:45:40.971306 ip-10-0-141-123 kubenswrapper[2550]: I0702 21:45:40.971239 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kckxl_f319c121-9f17-4829-a2f8-d2825773ea94/tuned/0.log"