Jul 01 19:16:16.485998 ip-10-0-135-98 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 19:16:16.486010 ip-10-0-135-98 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 19:16:16.486016 ip-10-0-135-98 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 19:16:16.486321 ip-10-0-135-98 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 19:16:26.523024 ip-10-0-135-98 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 19:16:26.523041 ip-10-0-135-98 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f8ab78f933e3453984db382a298ede58 -- Jul 01 19:18:22.805402 ip-10-0-135-98 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:18:23.143380 ip-10-0-135-98 kubenswrapper[2588]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:23.143380 ip-10-0-135-98 kubenswrapper[2588]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:18:23.143380 ip-10-0-135-98 kubenswrapper[2588]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:23.143380 ip-10-0-135-98 kubenswrapper[2588]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:18:23.143380 ip-10-0-135-98 kubenswrapper[2588]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:23.143380 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.141321 2588 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150627 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150644 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150648 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150651 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150655 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150658 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150661 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150663 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150666 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150669 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150672 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150675 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150678 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150681 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150684 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150686 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150689 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150692 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150694 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:23.159456 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150697 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150700 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150703 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150706 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150709 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150712 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150716 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150720 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150723 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150726 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150728 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150730 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150734 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150736 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150740 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150743 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150745 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150748 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150751 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:23.201696 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150756 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150760 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150763 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150768 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150771 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150774 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150777 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150780 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150782 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150785 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150787 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150790 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150792 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150799 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150802 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150805 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150807 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150810 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150812 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150815 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:23.221159 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150818 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150821 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150825 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150828 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150831 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150835 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150837 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150840 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150843 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150846 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150849 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150851 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150854 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150857 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150859 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150862 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150865 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150867 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150870 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150872 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:23.471407 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150875 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:23.240457 ip-10-0-135-98 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150877 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150881 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150883 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150886 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150889 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150891 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150894 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150896 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150899 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150901 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150904 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150906 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150909 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150911 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150914 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150918 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150920 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150923 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150925 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:23.484049 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.150928 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151674 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151682 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151685 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151688 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151691 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151694 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151696 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151699 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151702 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151704 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151707 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151710 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151712 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151715 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151717 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151720 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151722 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151726 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151729 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:23.484836 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151732 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151735 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151738 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151740 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151743 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151745 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151748 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151750 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151753 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151755 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151758 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151760 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151763 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151766 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151769 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151771 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151774 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151777 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151782 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151785 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:23.485646 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151788 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151790 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151793 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151795 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151798 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151800 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151803 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151805 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151808 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151810 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151813 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151817 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151819 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151822 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151825 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151827 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151830 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151832 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151835 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151837 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:23.486470 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151840 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151843 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151845 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151848 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151851 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151853 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151856 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151858 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151862 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151867 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151871 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151874 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151877 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151879 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151882 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151885 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151887 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151890 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151892 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151895 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:23.487499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151897 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151900 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151902 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151906 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151909 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151912 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151916 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151920 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151924 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151927 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151930 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151933 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151935 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151938 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151941 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151944 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151947 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151951 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151954 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:23.488137 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.151957 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152358 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152364 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152368 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152371 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152374 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152377 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152379 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152382 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152386 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152390 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152393 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152396 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152399 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152402 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152405 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152407 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152411 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152414 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:23.488747 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152416 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152419 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152421 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152424 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152426 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152429 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152432 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152434 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152437 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152440 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152445 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152448 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152451 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152454 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152456 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152459 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152463 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152467 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152469 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152472 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:23.489361 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152474 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152477 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152479 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152482 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152484 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152487 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152490 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152492 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152495 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152497 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152499 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152502 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152505 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152508 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152510 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152513 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152515 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152520 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152523 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:23.489966 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152526 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152528 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152531 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152535 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152537 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152540 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152543 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152546 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152548 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152552 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152555 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152558 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152560 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152563 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152566 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152568 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152571 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152573 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152576 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152579 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:23.490536 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152583 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152586 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152588 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152591 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152593 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152597 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152600 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152602 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152605 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152607 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152609 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152612 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152614 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152616 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152619 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152622 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152625 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152627 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152630 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:23.491177 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152632 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152635 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.152638 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152721 2588 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152728 2588 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152738 2588 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152743 2588 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152747 2588 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152750 2588 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152754 2588 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152758 2588 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152761 2588 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152764 2588 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152768 2588 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152771 2588 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152774 2588 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152777 2588 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152780 2588 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152783 2588 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152786 2588 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152789 2588 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152793 2588 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152796 2588 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152799 2588 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:18:23.491720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152802 2588 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152806 2588 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152809 2588 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152812 2588 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152816 2588 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152820 2588 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152822 2588 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152825 2588 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152828 2588 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152831 2588 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152835 2588 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152839 2588 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152843 2588 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152845 2588 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152848 2588 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152851 2588 flags.go:64] FLAG: --enable-server="true" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152854 2588 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152858 2588 flags.go:64] FLAG: --event-burst="100" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152861 2588 flags.go:64] FLAG: --event-qps="50" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152864 2588 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152868 2588 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152871 2588 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152875 2588 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152878 2588 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152881 2588 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:18:23.492620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152884 2588 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152887 2588 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152890 2588 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152893 2588 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152896 2588 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152899 2588 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152902 2588 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152904 2588 flags.go:64] FLAG: --feature-gates="" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152908 2588 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152911 2588 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152914 2588 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152918 2588 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152921 2588 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152924 2588 flags.go:64] FLAG: --help="false" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152926 2588 flags.go:64] FLAG: --hostname-override="ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152929 2588 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152932 2588 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152936 2588 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152939 2588 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152943 2588 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152946 2588 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152948 2588 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152951 2588 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:18:23.493428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152954 2588 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152957 2588 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152960 2588 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152962 2588 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152965 2588 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152968 2588 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152971 2588 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152973 2588 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152976 2588 flags.go:64] FLAG: --lock-file="" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152979 2588 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152982 2588 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152985 2588 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152990 2588 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152993 2588 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152996 2588 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.152998 2588 flags.go:64] FLAG: --logging-format="text" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153001 2588 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153004 2588 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153007 2588 flags.go:64] FLAG: --manifest-url="" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153009 2588 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153015 2588 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153018 2588 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153021 2588 flags.go:64] FLAG: --max-pods="110" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153024 2588 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153027 2588 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:18:23.494161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153030 2588 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153034 2588 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153037 2588 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153041 2588 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153044 2588 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153051 2588 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153069 2588 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153073 2588 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153076 2588 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153079 2588 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153085 2588 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153087 2588 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153090 2588 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153093 2588 flags.go:64] FLAG: --port="10250" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153096 2588 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153099 2588 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9b8b54fe6f820e4" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153102 2588 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153105 2588 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153108 2588 flags.go:64] FLAG: --register-node="true" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153111 2588 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153115 2588 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153121 2588 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153124 2588 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153127 2588 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153130 2588 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:18:23.494821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153133 2588 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153136 2588 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153140 2588 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153143 2588 flags.go:64] FLAG: --runonce="false" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153146 2588 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153149 2588 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153152 2588 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153155 2588 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153158 2588 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153162 2588 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153165 2588 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153168 2588 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153170 2588 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153174 2588 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153176 2588 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153179 2588 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153182 2588 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153185 2588 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153188 2588 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153193 2588 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153196 2588 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153198 2588 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153202 2588 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153205 2588 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153208 2588 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:18:23.495516 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153211 2588 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153213 2588 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153216 2588 flags.go:64] FLAG: --v="2" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153220 2588 flags.go:64] FLAG: --version="false" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153225 2588 flags.go:64] FLAG: --vmodule="" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153228 2588 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.153231 2588 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153349 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153352 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153357 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153360 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153363 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153365 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153368 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153371 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153373 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153377 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153380 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153382 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153385 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153388 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:23.496190 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153390 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153393 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153395 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153398 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153401 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153403 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153405 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153408 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153410 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153413 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153415 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153418 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153421 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153423 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153426 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153428 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153431 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153433 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153436 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153438 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:23.496936 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153442 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153444 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153447 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153449 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153452 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153456 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153459 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153463 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153466 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153469 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153471 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153474 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153477 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153479 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153482 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153484 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153487 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153489 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153492 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:23.500686 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153494 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153497 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153500 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153502 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153505 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153507 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153509 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153512 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153514 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153517 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153520 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153522 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153525 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153528 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153531 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153533 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153536 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153538 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153541 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153543 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:23.501295 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153547 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153551 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153554 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153557 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153560 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153563 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153565 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153568 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153571 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153575 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153578 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153581 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153583 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153586 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153588 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153591 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153593 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153596 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153598 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:23.628761 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153601 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153603 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153606 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153608 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153611 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153614 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.153617 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.154285 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.161475 2588 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.161491 2588 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.162386 2588 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.162394 2588 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162451 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162457 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162461 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:23.629387 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162464 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162467 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162470 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162473 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162476 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162479 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162482 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162484 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162487 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162489 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162492 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162495 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162497 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162500 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162503 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162505 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162508 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162510 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162513 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162517 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:23.630018 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162521 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162524 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162527 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162530 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162533 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162536 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162540 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162542 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162545 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162547 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162550 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162552 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162555 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162558 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162560 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162562 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162565 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162567 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162570 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162572 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:23.630645 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162575 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162577 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162580 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162583 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162586 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162588 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162591 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162593 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162596 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162598 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162601 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162603 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162606 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162608 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162610 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162616 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162619 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162621 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162624 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:23.631264 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162627 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162630 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162633 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162635 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162638 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162642 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162645 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162648 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162650 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162653 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162655 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162658 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162661 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162664 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162666 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162669 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162672 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162674 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162677 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:23.631890 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162680 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162682 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162685 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162687 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162690 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162692 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162695 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162697 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162700 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162705 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162708 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162711 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162714 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162717 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162720 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162723 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162725 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:23.632509 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162728 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.162733 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162847 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162852 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162855 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162858 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162861 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162865 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162869 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162872 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162875 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162878 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162880 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162884 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162887 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:23.633337 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162889 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162892 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162895 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162898 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162901 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162903 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162906 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162908 2588 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162911 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162915 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162917 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162920 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162922 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162925 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162927 2588 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162931 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162933 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162936 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162939 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162941 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:23.633787 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162944 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162946 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162949 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162951 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162954 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162956 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162959 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162961 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162964 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162967 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162970 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162974 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162977 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162980 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162982 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162985 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162988 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162991 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162993 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162996 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:23.634363 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.162999 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163004 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163007 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163009 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163012 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163014 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163017 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163020 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163023 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163025 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163028 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163030 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163033 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163035 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163038 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163040 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163042 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163045 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163047 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163050 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:23.634892 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163052 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163074 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163078 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163081 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163085 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163089 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163093 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163096 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163098 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163101 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163105 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163108 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163113 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163117 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163120 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163123 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163125 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163128 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163131 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:23.635499 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163134 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163136 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163140 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163143 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163145 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163148 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:23.163150 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.163155 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.163283 2588 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.165680 2588 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.169222 2588 server.go:1019] "Starting client certificate rotation" Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.169323 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.169357 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:18:23.635994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.171862 2588 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.173086 2588 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.192400 2588 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.194941 2588 log.go:25] "Validated CRI v1 image API" Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.195705 2588 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.202216 2588 fs.go:135] Filesystem UUIDs: map[00d45d84-25ee-4fe4-99e3-ee3e25f86568:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ff1b8330-3f63-4905-bf43-543cc760070f:/dev/nvme0n1p4] Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.202237 2588 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:18:23.636454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.204684 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.207660 2588 manager.go:216] Machine: {Timestamp:2026-07-01 19:18:23.206160787 +0000 UTC m=+0.300913850 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3126508 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2856b17b4c4b890903b9fc73d2b2cc SystemUUID:ec2856b1-7b4c-4b89-0903-b9fc73d2b2cc BootID:f8ab78f9-33e3-4539-84db-382a298ede58 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:a3:da:c7:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:a3:da:c7:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:90:65:e6:83:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.207773 2588 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.207862 2588 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.211815 2588 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.211845 2588 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.212712 2588 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.212724 2588 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.212732 2588 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.214314 2588 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.215548 2588 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220319 2588 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220458 2588 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220487 2588 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220497 2588 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220515 2588 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220527 2588 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220536 2588 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:18:23.636755 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220924 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.220941 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.223421 2588 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225401 2588 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225432 2588 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225589 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225606 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225614 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225623 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225632 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.225640 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.226206 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.226214 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.226226 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.226232 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.226241 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.226249 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.227830 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.227838 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.233517 2588 server.go:1268] "Started kubelet" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.233570 2588 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.233690 2588 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.233973 2588 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.238393 2588 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.238980 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zj7n" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.239151 2588 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.239216 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.239358 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.240039 2588 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.241594 2588 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.241722 2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-98.ec2.internal.18be4093265c4f2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-98.ec2.internal,UID:ip-10-0-135-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-98.ec2.internal,},FirstTimestamp:2026-07-01 19:18:23.233249067 +0000 UTC m=+0.328002120,LastTimestamp:2026-07-01 19:18:23.233249067 +0000 UTC m=+0.328002120,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-98.ec2.internal,}" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.246619 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zj7n" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.247209 2588 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.247222 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.247337 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.247906 2588 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.247931 2588 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.247942 2588 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.248098 2588 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.248106 2588 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:18:23.637296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249093 2588 factory.go:153] Registering CRI-O factory Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249108 2588 factory.go:223] Registration of the crio container factory successfully Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249165 2588 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249177 2588 factory.go:55] Registering systemd factory Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249186 2588 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249210 2588 factory.go:103] Registering Raw factory Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249224 2588 manager.go:1196] Started watching for new ooms in manager Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.249386 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.249477 2588 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.249673 2588 manager.go:349] Starting recovery of all containers Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.259678 2588 manager.go:354] Recovery completed Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.266229 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268160 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268202 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268212 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268833 2588 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268842 2588 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268856 2588 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.268915 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.269626 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.269661 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.269676 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.270998 2588 policy_none.go:49] "None policy: Start" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.271011 2588 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.271020 2588 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.273096 2588 policy_none.go:47] "Start" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.308611 2588 manager.go:337] "Starting Device Plugin manager" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.308644 2588 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.308657 2588 server.go:87] "Starting device plugin registration server" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.308927 2588 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.308940 2588 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.309173 2588 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.309262 2588 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.309271 2588 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.309579 2588 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.309622 2588 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.324282 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.325370 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.325403 2588 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.325422 2588 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.325453 2588 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.327996 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.409098 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.410212 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.410250 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.410261 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.410285 2588 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.638373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.416349 2588 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.416370 2588 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-98.ec2.internal\": node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.426443 2588 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"] Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.426504 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.427350 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.427380 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.427390 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.429712 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.429859 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.429890 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.430424 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.430446 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.430455 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.430480 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.430503 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.430517 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.432696 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.445008 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.445038 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.445877 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.445911 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.445922 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.449416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4610d8276494fdd104fd1034cc156bdd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"4610d8276494fdd104fd1034cc156bdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.449443 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4610d8276494fdd104fd1034cc156bdd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"4610d8276494fdd104fd1034cc156bdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.449461 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1294a42dcee61098075b8c041b6bfbf9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-98.ec2.internal\" (UID: \"1294a42dcee61098075b8c041b6bfbf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.460740 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-98.ec2.internal\" not found" node="ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.470295 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-98.ec2.internal\" not found" node="ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.533504 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.550423 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1294a42dcee61098075b8c041b6bfbf9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-98.ec2.internal\" (UID: \"1294a42dcee61098075b8c041b6bfbf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.639559 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.550445 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4610d8276494fdd104fd1034cc156bdd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"4610d8276494fdd104fd1034cc156bdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.640367 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.550462 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4610d8276494fdd104fd1034cc156bdd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"4610d8276494fdd104fd1034cc156bdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.640367 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.550500 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4610d8276494fdd104fd1034cc156bdd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"4610d8276494fdd104fd1034cc156bdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.640367 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.550537 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1294a42dcee61098075b8c041b6bfbf9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-98.ec2.internal\" (UID: \"1294a42dcee61098075b8c041b6bfbf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.640367 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.550546 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4610d8276494fdd104fd1034cc156bdd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"4610d8276494fdd104fd1034cc156bdd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.640367 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.633811 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.737999 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.734184 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.800130 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.765663 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.800130 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:23.773844 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" Jul 01 19:18:23.891051 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.835112 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:23.970325 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:23.935610 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.057732 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.036224 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.138506 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.136846 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.239680 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.168242 2588 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:18:24.239680 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.168391 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:18:24.239680 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.237661 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.335821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.254235 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:13:23 +0000 UTC" deadline="2028-04-18 18:28:19.21941084 +0000 UTC" Jul 01 19:18:24.335821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.254258 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15767h9m54.965155817s" Jul 01 19:18:24.335821 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.323623 2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:24.340364 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.338094 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.441560 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.439118 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.597937 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.540197 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.703373 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:24.609935 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4610d8276494fdd104fd1034cc156bdd.slice/crio-8c0ea9a99c990161ade5966897db0b5a43300dfa652f4c1295121dbc2a08873b WatchSource:0}: Error finding container 8c0ea9a99c990161ade5966897db0b5a43300dfa652f4c1295121dbc2a08873b: Status 404 returned error can't find the container with id 8c0ea9a99c990161ade5966897db0b5a43300dfa652f4c1295121dbc2a08873b Jul 01 19:18:24.703373 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:24.610827 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1294a42dcee61098075b8c041b6bfbf9.slice/crio-176bf3c353c927ff5fbb3ee13b9117ba0fbd701339e50645a2d161054d62f636 WatchSource:0}: Error finding container 176bf3c353c927ff5fbb3ee13b9117ba0fbd701339e50645a2d161054d62f636: Status 404 returned error can't find the container with id 176bf3c353c927ff5fbb3ee13b9117ba0fbd701339e50645a2d161054d62f636 Jul 01 19:18:24.703373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.626940 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:18:24.703373 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:24.640358 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found" Jul 01 19:18:24.703373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.684420 2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:24.732738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.732712 2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:24.748166 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.748143 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" Jul 01 19:18:24.761103 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.761089 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:18:24.762336 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.762323 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" Jul 01 19:18:24.774770 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:24.774754 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:18:25.222143 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.222107 2588 apiserver.go:52] "Watching apiserver" Jul 01 19:18:25.235116 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.235075 2588 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:18:25.236418 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.236388 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2","openshift-cluster-node-tuning-operator/tuned-4nfpf","openshift-dns/node-resolver-lp58q","openshift-image-registry/node-ca-b8mrb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal","openshift-multus/multus-additional-cni-plugins-l2rxc","openshift-multus/network-metrics-daemon-ldg2k","openshift-network-diagnostics/network-check-target-l826r","kube-system/global-pull-secret-syncer-nxldv","kube-system/konnectivity-agent-m5grh","kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal","openshift-multus/multus-rhvv5","openshift-network-operator/iptables-alerter-tffz6","openshift-ovn-kubernetes/ovnkube-node-s5qtk"] Jul 01 19:18:25.239129 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.239107 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.239264 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.239200 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:25.241439 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.241412 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:25.241992 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.241487 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:25.243836 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.243804 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.246160 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.246137 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.246685 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.246663 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.247548 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.247527 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tf2d8\"" Jul 01 19:18:25.247636 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.247576 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.248537 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.248505 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:18:25.248739 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.248717 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.249685 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.249392 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.249685 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.249417 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.249685 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.249519 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:18:25.249685 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.249685 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n6xbz\"" Jul 01 19:18:25.251671 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.251252 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.251671 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.251313 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.251813 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.251688 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hhsf\"" Jul 01 19:18:25.251813 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.251785 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:18:25.251969 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.251927 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.253653 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.253631 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.253761 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.253715 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:25.254111 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.254091 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.254645 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.254204 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wdvdl\"" Jul 01 19:18:25.254645 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.254357 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:18:25.254645 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.254434 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:18:25.254645 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.254462 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:18:25.254645 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.254477 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.256218 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.256182 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.258677 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.258649 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.259110 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.258802 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.259110 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.258955 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.259484 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.259464 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:18:25.259599 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.259464 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hw7md\"" Jul 01 19:18:25.261649 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261514 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.261649 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261576 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.261819 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261792 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.261880 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261826 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdmh\" (UniqueName: \"kubernetes.io/projected/24b5f333-5271-4beb-a719-e2c8307779d3-kube-api-access-8kdmh\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.261880 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261858 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.261989 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261882 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-socket-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.261989 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261908 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-registration-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.261989 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261932 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-os-release\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.261989 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261961 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.261989 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.261986 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262013 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-device-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262056 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-etc-selinux\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262085 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-system-cni-dir\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262115 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p97tn\"" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262160 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262197 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262225 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.262262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262253 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gv4b\" (UniqueName: \"kubernetes.io/projected/4e795316-2daa-467f-8314-9dd493b73da1-kube-api-access-5gv4b\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262377 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bgxt\" (UniqueName: \"kubernetes.io/projected/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-kube-api-access-2bgxt\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24b5f333-5271-4beb-a719-e2c8307779d3-hosts-file\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262445 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-host\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262500 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b5f333-5271-4beb-a719-e2c8307779d3-tmp-dir\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262532 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-serviceca\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262564 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jzmz\" (UniqueName: \"kubernetes.io/projected/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-kube-api-access-4jzmz\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.262620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262602 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-sys-fs\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.263046 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262639 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hd8n\" (UniqueName: \"kubernetes.io/projected/937a0ffc-7862-41bc-b5a1-3d740e386511-kube-api-access-6hd8n\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.263046 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262676 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-cnibin\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.263046 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.262869 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.264657 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.264508 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:18:25.265533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.265509 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:18:25.265692 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.265633 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.265775 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.265757 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:18:25.266331 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.266306 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jg89v\"" Jul 01 19:18:25.269316 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.268688 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:18:25.269316 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.268699 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4r4c5\"" Jul 01 19:18:25.269316 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.269152 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.271413 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.270384 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:18:25.271413 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.270697 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:18:25.271413 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.270939 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:18:25.271413 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.271343 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:18:25.271710 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.271452 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:18:25.271934 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.271903 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-skph4\"" Jul 01 19:18:25.272748 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.272653 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:18:25.289291 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.289269 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lg5ch" Jul 01 19:18:25.301693 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.301662 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lg5ch" Jul 01 19:18:25.330964 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.330917 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" event={"ID":"1294a42dcee61098075b8c041b6bfbf9","Type":"ContainerStarted","Data":"176bf3c353c927ff5fbb3ee13b9117ba0fbd701339e50645a2d161054d62f636"} Jul 01 19:18:25.332190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.332161 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" event={"ID":"4610d8276494fdd104fd1034cc156bdd","Type":"ContainerStarted","Data":"8c0ea9a99c990161ade5966897db0b5a43300dfa652f4c1295121dbc2a08873b"} Jul 01 19:18:25.349562 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.349541 2588 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:18:25.363747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363716 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24b5f333-5271-4beb-a719-e2c8307779d3-hosts-file\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.363858 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363761 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-env-overrides\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.363858 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363791 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-conf-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.363858 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363819 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-serviceca\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.364034 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363867 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd8n\" (UniqueName: \"kubernetes.io/projected/937a0ffc-7862-41bc-b5a1-3d740e386511-kube-api-access-6hd8n\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364034 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363871 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24b5f333-5271-4beb-a719-e2c8307779d3-hosts-file\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.364034 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.363954 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-log-socket\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.364211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364080 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-netns\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.364211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364106 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-cni-multus\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.364211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364123 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-run\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.364211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364145 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.364211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364173 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd470645-2a19-4679-b59b-23e10114ce44-kubelet-config\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.364211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364200 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdmh\" (UniqueName: \"kubernetes.io/projected/24b5f333-5271-4beb-a719-e2c8307779d3-kube-api-access-8kdmh\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364225 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-registration-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364250 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-device-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364276 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364312 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-modprobe-d\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364328 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-device-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364328 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-cni-netd\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364355 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-registration-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364363 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-system-cni-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364373 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-serviceca\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.364445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364409 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-cnibin\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364447 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-host\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364480 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-host\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364521 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-host\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364525 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovn-node-metrics-cert\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364549 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-socket-dir-parent\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364564 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-multus-certs\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364583 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-sys-fs\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364602 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-tuned\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364624 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-kubelet\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364645 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-slash\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364652 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-sys-fs\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.364727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364667 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-ovn\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364729 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364761 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovnkube-script-lib\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364782 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364792 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364818 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-os-release\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364836 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8d58c17-becb-4397-b74c-4ce0c99141a4-tmp\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364850 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-etc-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364872 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364904 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovnkube-config\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364922 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-os-release\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364957 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbkj\" (UniqueName: \"kubernetes.io/projected/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-kube-api-access-vwbkj\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.364980 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.364998 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-host-slash\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365025 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8c9v\" (UniqueName: \"kubernetes.io/projected/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-kube-api-access-q8c9v\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.365068 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:25.865029264 +0000 UTC m=+2.959782320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:25.365188 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365104 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-systemd\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365146 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b022344e-a864-48fd-9799-272e7b7ef7f8-konnectivity-ca\") pod \"konnectivity-agent-m5grh\" (UID: \"b022344e-a864-48fd-9799-272e7b7ef7f8\") " pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365178 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-systemd\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365216 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-var-lib-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365241 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-cni-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365265 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-cni-bin\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365288 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd470645-2a19-4679-b59b-23e10114ce44-dbus\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365312 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-kubernetes\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365344 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysctl-d\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365369 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-os-release\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365425 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-etc-kubernetes\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365459 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c59zv\" (UniqueName: \"kubernetes.io/projected/0e19668c-496c-4711-b887-41a2747eb123-kube-api-access-c59zv\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365500 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jzmz\" (UniqueName: \"kubernetes.io/projected/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-kube-api-access-4jzmz\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365523 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-cnibin\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365567 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365600 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysctl-conf\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365624 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh594\" (UniqueName: \"kubernetes.io/projected/f8d58c17-becb-4397-b74c-4ce0c99141a4-kube-api-access-qh594\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.365900 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365649 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-cnibin\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365654 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e19668c-496c-4711-b887-41a2747eb123-multus-daemon-config\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365694 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-iptables-alerter-script\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365724 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-systemd-units\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365752 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365777 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gv4b\" (UniqueName: \"kubernetes.io/projected/4e795316-2daa-467f-8314-9dd493b73da1-kube-api-access-5gv4b\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365802 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365889 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365940 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-socket-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365953 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.365967 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-node-log\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366043 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-etc-selinux\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366059 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-socket-dir\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366069 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-system-cni-dir\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366117 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b022344e-a864-48fd-9799-272e7b7ef7f8-agent-certs\") pod \"konnectivity-agent-m5grh\" (UID: \"b022344e-a864-48fd-9799-272e7b7ef7f8\") " pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.366796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366146 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366160 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e795316-2daa-467f-8314-9dd493b73da1-system-cni-dir\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366160 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-k8s-cni-cncf-io\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366227 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bgxt\" (UniqueName: \"kubernetes.io/projected/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-kube-api-access-2bgxt\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366255 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-sys\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366260 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/937a0ffc-7862-41bc-b5a1-3d740e386511-etc-selinux\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366295 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-var-lib-kubelet\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366320 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366342 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-hostroot\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366369 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b5f333-5271-4beb-a719-e2c8307779d3-tmp-dir\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366393 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e19668c-496c-4711-b887-41a2747eb123-cni-binary-copy\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-run-netns\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366441 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366470 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysconfig\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366505 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-lib-modules\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366580 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-cni-bin\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366607 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-kubelet\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.367502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366669 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b5f333-5271-4beb-a719-e2c8307779d3-tmp-dir\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.368367 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.366994 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e795316-2daa-467f-8314-9dd493b73da1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.370765 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.370744 2588 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:18:25.374462 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.374432 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdmh\" (UniqueName: \"kubernetes.io/projected/24b5f333-5271-4beb-a719-e2c8307779d3-kube-api-access-8kdmh\") pod \"node-resolver-lp58q\" (UID: \"24b5f333-5271-4beb-a719-e2c8307779d3\") " pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.374569 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.374441 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hd8n\" (UniqueName: \"kubernetes.io/projected/937a0ffc-7862-41bc-b5a1-3d740e386511-kube-api-access-6hd8n\") pod \"aws-ebs-csi-driver-node-7qqg2\" (UID: \"937a0ffc-7862-41bc-b5a1-3d740e386511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.375044 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.375020 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:25.375044 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.375044 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:25.375214 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.375059 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:25.375214 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.375120 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:25.875100716 +0000 UTC m=+2.969853767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:25.377746 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.377719 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gv4b\" (UniqueName: \"kubernetes.io/projected/4e795316-2daa-467f-8314-9dd493b73da1-kube-api-access-5gv4b\") pod \"multus-additional-cni-plugins-l2rxc\" (UID: \"4e795316-2daa-467f-8314-9dd493b73da1\") " pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.377966 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.377945 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jzmz\" (UniqueName: \"kubernetes.io/projected/6a8caa4a-edc6-4a8f-94a1-9f666d7319a6-kube-api-access-4jzmz\") pod \"node-ca-b8mrb\" (UID: \"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6\") " pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.378044 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.377980 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bgxt\" (UniqueName: \"kubernetes.io/projected/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-kube-api-access-2bgxt\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.467272 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467234 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-node-log\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.467449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467299 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b022344e-a864-48fd-9799-272e7b7ef7f8-agent-certs\") pod \"konnectivity-agent-m5grh\" (UID: \"b022344e-a864-48fd-9799-272e7b7ef7f8\") " pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.467449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467359 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-k8s-cni-cncf-io\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.467449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467406 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-sys\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.467449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467432 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-var-lib-kubelet\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467462 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467485 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-hostroot\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467514 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e19668c-496c-4711-b887-41a2747eb123-cni-binary-copy\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467539 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-run-netns\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467565 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysconfig\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467591 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-lib-modules\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467616 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-cni-bin\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467639 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-kubelet\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.467695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467663 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-env-overrides\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467709 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-conf-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467738 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-log-socket\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467786 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-netns\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467814 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-cni-multus\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467840 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-run\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467865 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd470645-2a19-4679-b59b-23e10114ce44-kubelet-config\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467879 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-kubelet\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467893 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467934 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-modprobe-d\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467963 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-cni-netd\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.467982 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-system-cni-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.467993 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468002 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-cnibin\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468021 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-host\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.468052 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:25.968031574 +0000 UTC m=+3.062784629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468065 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-host\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.468140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468072 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovn-node-metrics-cert\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468104 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-socket-dir-parent\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468114 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-run-netns\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468131 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-multus-certs\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468159 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysconfig\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468186 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-tuned\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468199 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-cni-netd\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468212 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-kubelet\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468239 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-slash\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468245 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-system-cni-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468266 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-modprobe-d\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468274 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-ovn\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468296 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-slash\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468322 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-ovn\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468375 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-cnibin\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468375 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-lib-modules\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468407 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468428 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-sys\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469060 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468439 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovnkube-script-lib\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468440 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e19668c-496c-4711-b887-41a2747eb123-cni-binary-copy\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468467 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-node-log\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468484 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8d58c17-becb-4397-b74c-4ce0c99141a4-tmp\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468505 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-k8s-cni-cncf-io\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468510 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-etc-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468515 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-var-lib-kubelet\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468546 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468549 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468564 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-cni-bin\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468584 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-hostroot\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468584 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovnkube-config\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468604 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468617 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbkj\" (UniqueName: \"kubernetes.io/projected/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-kube-api-access-vwbkj\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468637 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd470645-2a19-4679-b59b-23e10114ce44-kubelet-config\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468646 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-host-slash\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468680 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-conf-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468697 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-host-slash\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.469974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468710 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8c9v\" (UniqueName: \"kubernetes.io/projected/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-kube-api-access-q8c9v\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468737 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-systemd\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468764 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b022344e-a864-48fd-9799-272e7b7ef7f8-konnectivity-ca\") pod \"konnectivity-agent-m5grh\" (UID: \"b022344e-a864-48fd-9799-272e7b7ef7f8\") " pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468789 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-systemd\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468785 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-env-overrides\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468850 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-run-systemd\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468851 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-var-lib-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468893 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-cni-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468900 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-log-socket\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468919 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-cni-bin\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468944 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-netns\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468946 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd470645-2a19-4679-b59b-23e10114ce44-dbus\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.468986 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-kubernetes\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysctl-d\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469043 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-os-release\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469077 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-etc-kubernetes\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469105 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c59zv\" (UniqueName: \"kubernetes.io/projected/0e19668c-496c-4711-b887-41a2747eb123-kube-api-access-c59zv\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469151 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovnkube-script-lib\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.470960 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469160 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysctl-conf\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469174 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd470645-2a19-4679-b59b-23e10114ce44-dbus\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469130 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-systemd\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469227 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-etc-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469266 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-cni-multus\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469437 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh594\" (UniqueName: \"kubernetes.io/projected/f8d58c17-becb-4397-b74c-4ce0c99141a4-kube-api-access-qh594\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469483 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e19668c-496c-4711-b887-41a2747eb123-multus-daemon-config\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469514 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-iptables-alerter-script\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469547 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-systemd-units\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469632 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-systemd-units\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469841 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysctl-conf\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.469899 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-kubernetes\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.470478 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e19668c-496c-4711-b887-41a2747eb123-multus-daemon-config\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.470577 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b022344e-a864-48fd-9799-272e7b7ef7f8-konnectivity-ca\") pod \"konnectivity-agent-m5grh\" (UID: \"b022344e-a864-48fd-9799-272e7b7ef7f8\") " pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.470484 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-iptables-alerter-script\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.470803 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-os-release\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.470971 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovnkube-config\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471032 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-socket-dir-parent\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.471894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471053 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-etc-kubernetes\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471099 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471242 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-sysctl-d\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471288 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-run-multus-certs\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471316 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-multus-cni-dir\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471344 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e19668c-496c-4711-b887-41a2747eb123-host-var-lib-cni-bin\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471366 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-host-kubelet\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471385 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-var-lib-openvswitch\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.472825 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.471416 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8d58c17-becb-4397-b74c-4ce0c99141a4-run\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.474239 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.474214 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8d58c17-becb-4397-b74c-4ce0c99141a4-tmp\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.475630 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.475569 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-ovn-node-metrics-cert\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.478577 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.478526 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8d58c17-becb-4397-b74c-4ce0c99141a4-etc-tuned\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.478988 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.478963 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b022344e-a864-48fd-9799-272e7b7ef7f8-agent-certs\") pod \"konnectivity-agent-m5grh\" (UID: \"b022344e-a864-48fd-9799-272e7b7ef7f8\") " pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.479427 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.479401 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8c9v\" (UniqueName: \"kubernetes.io/projected/a6c6f1c7-8a7d-4945-8678-5024bb4f6dee-kube-api-access-q8c9v\") pod \"iptables-alerter-tffz6\" (UID: \"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee\") " pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.479883 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.479858 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh594\" (UniqueName: \"kubernetes.io/projected/f8d58c17-becb-4397-b74c-4ce0c99141a4-kube-api-access-qh594\") pod \"tuned-4nfpf\" (UID: \"f8d58c17-becb-4397-b74c-4ce0c99141a4\") " pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.488002 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.487848 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbkj\" (UniqueName: \"kubernetes.io/projected/7edd23c6-3fb5-4dd2-97d7-3ef959e293c8-kube-api-access-vwbkj\") pod \"ovnkube-node-s5qtk\" (UID: \"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.489595 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.489549 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59zv\" (UniqueName: \"kubernetes.io/projected/0e19668c-496c-4711-b887-41a2747eb123-kube-api-access-c59zv\") pod \"multus-rhvv5\" (UID: \"0e19668c-496c-4711-b887-41a2747eb123\") " pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.556918 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.556754 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lp58q" Jul 01 19:18:25.561499 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.561466 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:25.564839 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.564798 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b8mrb" Jul 01 19:18:25.575866 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.575696 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" Jul 01 19:18:25.580995 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.580844 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" Jul 01 19:18:25.589038 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.589015 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tffz6" Jul 01 19:18:25.596243 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.596136 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" Jul 01 19:18:25.603344 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.603180 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:25.610499 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.610439 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:25.617030 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.616867 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rhvv5" Jul 01 19:18:25.874040 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.873942 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:25.874256 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.874128 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:25.874256 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.874204 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:26.874176769 +0000 UTC m=+3.968929815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:25.975265 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.975223 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:25.975425 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:25.975274 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:25.975425 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.975380 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:25.975425 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.975385 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:25.975425 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.975405 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:25.975425 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.975417 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:25.975694 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.975445 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:26.975425045 +0000 UTC m=+4.070178085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:25.975694 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:25.975464 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:26.975451743 +0000 UTC m=+4.070204784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:26.305772 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:26.305685 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:13:25 +0000 UTC" deadline="2028-03-30 13:39:23.024149396 +0000 UTC" Jul 01 19:18:26.305772 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:26.305723 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15306h20m56.71843352s" Jul 01 19:18:26.679520 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.679477 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e19668c_496c_4711_b887_41a2747eb123.slice/crio-9b7554677523478e12f3d5ce02529040b4bd8912b9dcacb35c1e41e20e5e2cd3 WatchSource:0}: Error finding container 9b7554677523478e12f3d5ce02529040b4bd8912b9dcacb35c1e41e20e5e2cd3: Status 404 returned error can't find the container with id 9b7554677523478e12f3d5ce02529040b4bd8912b9dcacb35c1e41e20e5e2cd3 Jul 01 19:18:26.685945 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.685916 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edd23c6_3fb5_4dd2_97d7_3ef959e293c8.slice/crio-636c9226b4b672ab9053940bcdf26d5d7b65c33ab7a1c5d262ae48313429e38c WatchSource:0}: Error finding container 636c9226b4b672ab9053940bcdf26d5d7b65c33ab7a1c5d262ae48313429e38c: Status 404 returned error can't find the container with id 636c9226b4b672ab9053940bcdf26d5d7b65c33ab7a1c5d262ae48313429e38c Jul 01 19:18:26.686898 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.686873 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d58c17_becb_4397_b74c_4ce0c99141a4.slice/crio-51f1b2f83a3568a4c70872ab9c2bedc226d6504d10318bc371c94c384e80bbf0 WatchSource:0}: Error finding container 51f1b2f83a3568a4c70872ab9c2bedc226d6504d10318bc371c94c384e80bbf0: Status 404 returned error can't find the container with id 51f1b2f83a3568a4c70872ab9c2bedc226d6504d10318bc371c94c384e80bbf0 Jul 01 19:18:26.688237 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.688189 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937a0ffc_7862_41bc_b5a1_3d740e386511.slice/crio-22bee72285a091c0318501535351ffd7fa1105c0b4122534027a4a61a6af49c6 WatchSource:0}: Error finding container 22bee72285a091c0318501535351ffd7fa1105c0b4122534027a4a61a6af49c6: Status 404 returned error can't find the container with id 22bee72285a091c0318501535351ffd7fa1105c0b4122534027a4a61a6af49c6 Jul 01 19:18:26.690033 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.690007 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb022344e_a864_48fd_9799_272e7b7ef7f8.slice/crio-ef559424600b7bc8020a4219cf87841f917612ca1d3d9a213071e16b01ce2829 WatchSource:0}: Error finding container ef559424600b7bc8020a4219cf87841f917612ca1d3d9a213071e16b01ce2829: Status 404 returned error can't find the container with id ef559424600b7bc8020a4219cf87841f917612ca1d3d9a213071e16b01ce2829 Jul 01 19:18:26.690778 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.690741 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e795316_2daa_467f_8314_9dd493b73da1.slice/crio-23f5cc6d921179581cd4a83a6f260d6cf6385692e32db2c103ed6803c3ea7556 WatchSource:0}: Error finding container 23f5cc6d921179581cd4a83a6f260d6cf6385692e32db2c103ed6803c3ea7556: Status 404 returned error can't find the container with id 23f5cc6d921179581cd4a83a6f260d6cf6385692e32db2c103ed6803c3ea7556 Jul 01 19:18:26.691815 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.691711 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b5f333_5271_4beb_a719_e2c8307779d3.slice/crio-096fc594d9d68d6f19cd0028c8160c0e751ffee79af41e68bd8160a1d32b7313 WatchSource:0}: Error finding container 096fc594d9d68d6f19cd0028c8160c0e751ffee79af41e68bd8160a1d32b7313: Status 404 returned error can't find the container with id 096fc594d9d68d6f19cd0028c8160c0e751ffee79af41e68bd8160a1d32b7313 Jul 01 19:18:26.692874 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.692657 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c6f1c7_8a7d_4945_8678_5024bb4f6dee.slice/crio-2d568371b0a031e6ac1cf1b1c6b0f2f6ce410f328cd52839c7c6193e2c816f81 WatchSource:0}: Error finding container 2d568371b0a031e6ac1cf1b1c6b0f2f6ce410f328cd52839c7c6193e2c816f81: Status 404 returned error can't find the container with id 2d568371b0a031e6ac1cf1b1c6b0f2f6ce410f328cd52839c7c6193e2c816f81 Jul 01 19:18:26.697300 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:26.697262 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8caa4a_edc6_4a8f_94a1_9f666d7319a6.slice/crio-95d51756116eabd75cd39e33e05517996c7d6ad444deece7cc5a5e4874224f08 WatchSource:0}: Error finding container 95d51756116eabd75cd39e33e05517996c7d6ad444deece7cc5a5e4874224f08: Status 404 returned error can't find the container with id 95d51756116eabd75cd39e33e05517996c7d6ad444deece7cc5a5e4874224f08 Jul 01 19:18:26.881176 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:26.880969 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:26.881340 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.881146 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:26.881340 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.881323 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:28.881301628 +0000 UTC m=+5.976054682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:26.981586 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:26.981556 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:26.981740 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:26.981629 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:26.981788 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.981748 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:26.981788 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.981751 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:26.981862 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.981764 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:26.981862 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.981847 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:28.981809231 +0000 UTC m=+6.076562285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:26.981862 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.981848 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:26.981976 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:26.981908 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:28.98189477 +0000 UTC m=+6.076647825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:27.307042 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.306922 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:13:25 +0000 UTC" deadline="2027-12-23 18:05:14.914528172 +0000 UTC" Jul 01 19:18:27.307042 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.306984 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12958h46m47.607548302s" Jul 01 19:18:27.326495 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.326463 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:27.326677 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:27.326607 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:27.327085 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.327044 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:27.327193 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:27.327168 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:27.327352 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.327335 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:27.327460 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:27.327439 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:27.339129 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.339040 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rhvv5" event={"ID":"0e19668c-496c-4711-b887-41a2747eb123","Type":"ContainerStarted","Data":"9b7554677523478e12f3d5ce02529040b4bd8912b9dcacb35c1e41e20e5e2cd3"} Jul 01 19:18:27.342783 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.342752 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" event={"ID":"1294a42dcee61098075b8c041b6bfbf9","Type":"ContainerStarted","Data":"275efdbb7cce699cbe1b5b1fa3e37e47d90309b17491d7b61efe6ecfbc29da83"} Jul 01 19:18:27.348574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.348415 2588 generic.go:356] "Generic (PLEG): container finished" podID="4610d8276494fdd104fd1034cc156bdd" containerID="12b1763733245315b9dcad7b4e4003913c6b6dd04e073b4ce2c9dc4a99aeac78" exitCode=0 Jul 01 19:18:27.348574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.348521 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" event={"ID":"4610d8276494fdd104fd1034cc156bdd","Type":"ContainerDied","Data":"12b1763733245315b9dcad7b4e4003913c6b6dd04e073b4ce2c9dc4a99aeac78"} Jul 01 19:18:27.353192 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.353163 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tffz6" event={"ID":"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee","Type":"ContainerStarted","Data":"2d568371b0a031e6ac1cf1b1c6b0f2f6ce410f328cd52839c7c6193e2c816f81"} Jul 01 19:18:27.355077 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.355047 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lp58q" event={"ID":"24b5f333-5271-4beb-a719-e2c8307779d3","Type":"ContainerStarted","Data":"096fc594d9d68d6f19cd0028c8160c0e751ffee79af41e68bd8160a1d32b7313"} Jul 01 19:18:27.372582 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.371868 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" event={"ID":"937a0ffc-7862-41bc-b5a1-3d740e386511","Type":"ContainerStarted","Data":"22bee72285a091c0318501535351ffd7fa1105c0b4122534027a4a61a6af49c6"} Jul 01 19:18:27.379912 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.379356 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" podStartSLOduration=2.379121053 podStartE2EDuration="2.379121053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:27.361100311 +0000 UTC m=+4.455853376" watchObservedRunningTime="2026-07-01 19:18:27.379121053 +0000 UTC m=+4.473874120" Jul 01 19:18:27.385381 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.385013 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" event={"ID":"f8d58c17-becb-4397-b74c-4ce0c99141a4","Type":"ContainerStarted","Data":"51f1b2f83a3568a4c70872ab9c2bedc226d6504d10318bc371c94c384e80bbf0"} Jul 01 19:18:27.396545 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.396511 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b8mrb" event={"ID":"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6","Type":"ContainerStarted","Data":"95d51756116eabd75cd39e33e05517996c7d6ad444deece7cc5a5e4874224f08"} Jul 01 19:18:27.401414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.401384 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerStarted","Data":"23f5cc6d921179581cd4a83a6f260d6cf6385692e32db2c103ed6803c3ea7556"} Jul 01 19:18:27.418961 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.418872 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m5grh" event={"ID":"b022344e-a864-48fd-9799-272e7b7ef7f8","Type":"ContainerStarted","Data":"ef559424600b7bc8020a4219cf87841f917612ca1d3d9a213071e16b01ce2829"} Jul 01 19:18:27.434103 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:27.433957 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"636c9226b4b672ab9053940bcdf26d5d7b65c33ab7a1c5d262ae48313429e38c"} Jul 01 19:18:28.444347 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:28.444199 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" event={"ID":"4610d8276494fdd104fd1034cc156bdd","Type":"ContainerStarted","Data":"0bb01da97a329703cf3bc4cb00aed60c79a637ed5cf54e3b3d2c34b59b5fff18"} Jul 01 19:18:28.900665 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:28.899939 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:28.900665 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:28.900132 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:28.900665 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:28.900205 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:32.900181535 +0000 UTC m=+9.994934589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:29.000642 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:29.000598 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:29.000852 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:29.000677 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:29.000922 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.000854 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:29.000922 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.000921 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:33.000902126 +0000 UTC m=+10.095655188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:29.001442 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.001368 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:29.001442 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.001397 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:29.001442 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.001411 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:29.001659 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.001462 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:33.001445326 +0000 UTC m=+10.096198367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:29.328012 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:29.327233 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:29.328012 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.327373 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:29.328012 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:29.327774 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:29.328012 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.327894 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:29.328371 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:29.328055 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:29.328371 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:29.328203 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:31.327115 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:31.326244 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:31.327115 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:31.326371 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:31.327115 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:31.326799 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:31.327115 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:31.326908 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:31.327115 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:31.326973 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:31.327115 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:31.327048 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:32.933957 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:32.933914 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:32.934514 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:32.934158 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:32.934514 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:32.934228 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:40.934207011 +0000 UTC m=+18.028960053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:33.034577 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:33.034536 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:33.034765 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:33.034607 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:33.034765 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.034729 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:33.034887 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.034797 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:41.03477793 +0000 UTC m=+18.129530990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:33.034887 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.034729 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:33.034887 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.034873 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:33.035040 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.034891 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:33.035040 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.034969 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:41.034951254 +0000 UTC m=+18.129704296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:33.327472 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:33.327386 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:33.327640 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.327508 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:33.327946 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:33.327923 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:33.328057 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.328034 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:33.328121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:33.328101 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:33.328237 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:33.328217 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:35.328636 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:35.327134 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:35.328636 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:35.327266 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:35.328636 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:35.327575 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:35.328636 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:35.327660 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:35.328636 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:35.328495 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:35.328636 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:35.328591 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:37.326312 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:37.326272 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:37.326754 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:37.326271 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:37.326754 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:37.326431 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:37.326754 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:37.326469 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:37.326754 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:37.326613 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:37.326919 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:37.326752 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:39.326338 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:39.326237 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:39.326338 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:39.326264 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:39.326338 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:39.326266 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:39.326925 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:39.326366 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:39.326925 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:39.326468 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:39.326925 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:39.326555 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:40.996732 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:40.996703 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:40.997176 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:40.996852 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:40.997176 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:40.996911 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:56.996891121 +0000 UTC m=+34.091644172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:41.097461 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:41.097430 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:41.097655 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:41.097491 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:41.097655 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.097610 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:41.097655 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.097623 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:41.097803 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.097695 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:57.097678236 +0000 UTC m=+34.192431277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:41.097803 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.097631 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:41.097803 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.097734 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:41.097803 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.097794 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:57.097779551 +0000 UTC m=+34.192532595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:41.326335 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:41.326255 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:41.326498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:41.326265 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:41.326498 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.326392 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:41.326498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:41.326272 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:41.326498 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.326469 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:41.326704 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:41.326553 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:43.327263 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:43.327231 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:43.327724 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:43.327331 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:43.327724 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:43.327373 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:43.327724 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:43.327414 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:43.327724 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:43.327462 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:43.327724 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:43.327560 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:45.325640 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:45.325605 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:45.326131 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:45.325605 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:45.326131 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:45.325749 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:45.326131 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:45.325867 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:45.326131 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:45.325605 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:45.326131 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:45.325964 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:46.496660 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.496482 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lp58q" event={"ID":"24b5f333-5271-4beb-a719-e2c8307779d3","Type":"ContainerStarted","Data":"4fdafbea1226d6f1daec25530061abb9a68ee60dfea37d97a9b6a17a1b279fa2"} Jul 01 19:18:46.498078 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.498026 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" event={"ID":"937a0ffc-7862-41bc-b5a1-3d740e386511","Type":"ContainerStarted","Data":"6f9ccd9f413c5c00945f0b01cb322dc6d1012c5e95b2fb20f7d8c2d127316e36"} Jul 01 19:18:46.499683 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.499612 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" event={"ID":"f8d58c17-becb-4397-b74c-4ce0c99141a4","Type":"ContainerStarted","Data":"d0a700fb2313dbd24a204230b0212956aa5009ed9c2b45706950a3abc4512213"} Jul 01 19:18:46.501433 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.501411 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b8mrb" event={"ID":"6a8caa4a-edc6-4a8f-94a1-9f666d7319a6","Type":"ContainerStarted","Data":"53858ac86cef7925b047127c922a664f8fdcb19a640813ff47889968b3bd33fd"} Jul 01 19:18:46.503167 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.503141 2588 generic.go:356] "Generic (PLEG): container finished" podID="4e795316-2daa-467f-8314-9dd493b73da1" containerID="5d4509a57eae661b4b487c893ea65aff56b65773d152aca91584abf53566afd8" exitCode=0 Jul 01 19:18:46.503281 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.503221 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerDied","Data":"5d4509a57eae661b4b487c893ea65aff56b65773d152aca91584abf53566afd8"} Jul 01 19:18:46.505338 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.505317 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m5grh" event={"ID":"b022344e-a864-48fd-9799-272e7b7ef7f8","Type":"ContainerStarted","Data":"98f8099350b6141267a9d806a4646b25c096b6640ed8f1bb3cf9cb6ea2f6d196"} Jul 01 19:18:46.508037 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.508014 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:18:46.508411 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.508390 2588 generic.go:356] "Generic (PLEG): container finished" podID="7edd23c6-3fb5-4dd2-97d7-3ef959e293c8" containerID="0ccbb7c859113ab0c5289601b02adf05668c94a9075c66c4bf6abd39a4971547" exitCode=1 Jul 01 19:18:46.508481 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.508452 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"bc58776a8cb9a7a4703048338276076ef6625205905c383306f42b2590f7366c"} Jul 01 19:18:46.508550 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.508534 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerDied","Data":"0ccbb7c859113ab0c5289601b02adf05668c94a9075c66c4bf6abd39a4971547"} Jul 01 19:18:46.508617 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.508593 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"9d2f29ee1e8eceba6b3a0fb3c3ad464f7562bf93ec22baa8826b5d05340ec1a4"} Jul 01 19:18:46.509951 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.509844 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rhvv5" event={"ID":"0e19668c-496c-4711-b887-41a2747eb123","Type":"ContainerStarted","Data":"3723fa1dc0b8b58fa8ba686b51069ad7a5ef8d9f16d06619df5e4351d9d9363e"} Jul 01 19:18:46.513411 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.513370 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lp58q" podStartSLOduration=3.158887365 podStartE2EDuration="22.513357882s" totalImagesPullingTime="19.354470517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:46.513028536 +0000 UTC m=+23.607781597" watchObservedRunningTime="2026-07-01 19:18:46.513357882 +0000 UTC m=+23.608110942" Jul 01 19:18:46.513518 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.513474 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" podStartSLOduration=21.513468022 podStartE2EDuration="21.513468022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:28.462978798 +0000 UTC m=+5.557731863" watchObservedRunningTime="2026-07-01 19:18:46.513468022 +0000 UTC m=+23.608221082" Jul 01 19:18:46.543540 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.543502 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b8mrb" podStartSLOduration=3.195369196 podStartE2EDuration="22.54348678s" totalImagesPullingTime="19.348117584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:46.528215941 +0000 UTC m=+23.622969003" watchObservedRunningTime="2026-07-01 19:18:46.54348678 +0000 UTC m=+23.638239844" Jul 01 19:18:46.543763 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.543745 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m5grh" podStartSLOduration=3.331863306 podStartE2EDuration="22.543740064s" totalImagesPullingTime="19.211876758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:46.543223936 +0000 UTC m=+23.637976997" watchObservedRunningTime="2026-07-01 19:18:46.543740064 +0000 UTC m=+23.638493125" Jul 01 19:18:46.564994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.564936 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rhvv5" podStartSLOduration=3.120123812 podStartE2EDuration="22.564925049s" totalImagesPullingTime="19.444801237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:46.564360779 +0000 UTC m=+23.659113841" watchObservedRunningTime="2026-07-01 19:18:46.564925049 +0000 UTC m=+23.659678106" Jul 01 19:18:46.603186 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:46.603128 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4nfpf" podStartSLOduration=3.214422691 podStartE2EDuration="22.603111101s" totalImagesPullingTime="19.38868841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:46.602678883 +0000 UTC m=+23.697431944" watchObservedRunningTime="2026-07-01 19:18:46.603111101 +0000 UTC m=+23.697864162" Jul 01 19:18:47.326734 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.326700 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:47.326998 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.326710 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:47.326998 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:47.326831 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:47.326998 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.326710 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:47.326998 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:47.326908 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:47.327227 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:47.326995 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:47.514361 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.514332 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:18:47.514754 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.514636 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"30dbe5044a0b3d95314b427aa5505917da3418ab24298114b879d7e23ba1eb95"} Jul 01 19:18:47.514754 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.514719 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"bf63a43179726564fb1400f7a0849e3393ba98688715e15eb1325b149e8443fb"} Jul 01 19:18:47.514754 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.514752 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"cfc72ad863d1828c8137041e6b51b7eb974d3358d5092d9d609dd45e6b988e27"} Jul 01 19:18:47.682380 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.682356 2588 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:18:47.739764 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.739727 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:47.740477 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:47.740458 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:48.323474 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.323360 2588 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:18:47.682373892Z","UUID":"a31eb63b-777e-4b4e-896e-93e4500469cd","Handler":null,"Name":"","Endpoint":""} Jul 01 19:18:48.325435 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.325409 2588 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:18:48.325626 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.325455 2588 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:18:48.519364 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.519331 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" event={"ID":"937a0ffc-7862-41bc-b5a1-3d740e386511","Type":"ContainerStarted","Data":"0b6df4d4b5288caf4c7fbe3d99fdd4e99eb1395690cfd8efbf5964bb9704c43f"} Jul 01 19:18:48.520996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.520969 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tffz6" event={"ID":"a6c6f1c7-8a7d-4945-8678-5024bb4f6dee","Type":"ContainerStarted","Data":"0b464a026cc0887c1265bf04f151ae5223bc5acffa3a0dd68a9bb8396257d191"} Jul 01 19:18:48.521285 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.521227 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:48.521722 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.521705 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m5grh" Jul 01 19:18:48.535560 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:48.535509 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tffz6" podStartSLOduration=5.154299518 podStartE2EDuration="24.535494085s" totalImagesPullingTime="19.381194567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:48.535454912 +0000 UTC m=+25.630207994" watchObservedRunningTime="2026-07-01 19:18:48.535494085 +0000 UTC m=+25.630247145" Jul 01 19:18:49.326325 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.326293 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:49.326554 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.326293 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:49.326554 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:49.326406 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:49.326554 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.326425 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:49.326554 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:49.326520 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:49.326720 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:49.326629 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:49.526236 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.525949 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" event={"ID":"937a0ffc-7862-41bc-b5a1-3d740e386511","Type":"ContainerStarted","Data":"319f1d8cfaaf6caf152e3865ffe78397ed865f78eef76564366f6be22d4702d9"} Jul 01 19:18:49.529766 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.529743 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:18:49.530209 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.530184 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"17b3fb3ae85121fd79beb9af8e4c86d84b3606938ebfdaf8ef342fc28c8d54b8"} Jul 01 19:18:49.543233 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:49.543184 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7qqg2" podStartSLOduration=3.4826693300000002 podStartE2EDuration="25.543167856s" totalImagesPullingTime="22.060498526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:49.542835031 +0000 UTC m=+26.637588093" watchObservedRunningTime="2026-07-01 19:18:49.543167856 +0000 UTC m=+26.637920921" Jul 01 19:18:51.326804 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.326561 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:51.327467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.326593 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:51.327467 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:51.326823 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:51.327467 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:51.326908 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:51.327467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.326606 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:51.327467 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:51.327006 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:51.536309 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.536281 2588 generic.go:356] "Generic (PLEG): container finished" podID="4e795316-2daa-467f-8314-9dd493b73da1" containerID="c236b9f1a8f6897a1c110e3655a75ed8de0849243e4c81ccbf4aabf890fe70e8" exitCode=0 Jul 01 19:18:51.536454 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.536373 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerDied","Data":"c236b9f1a8f6897a1c110e3655a75ed8de0849243e4c81ccbf4aabf890fe70e8"} Jul 01 19:18:51.540000 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.539983 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:18:51.540380 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.540358 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"211df1db232bbcce0d3c60c74c1278243e6de0490584b4b60c037ad2ab768fb6"} Jul 01 19:18:51.540704 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.540681 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:51.540810 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.540755 2588 scope.go:117] "RemoveContainer" containerID="0ccbb7c859113ab0c5289601b02adf05668c94a9075c66c4bf6abd39a4971547" Jul 01 19:18:51.559343 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:51.559321 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:52.547550 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:52.547527 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:18:52.547985 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:52.547845 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" event={"ID":"7edd23c6-3fb5-4dd2-97d7-3ef959e293c8","Type":"ContainerStarted","Data":"d1b3ac227d3663ea44126967be285e0778306bcc6be2072e93b436fab4fb7976"} Jul 01 19:18:52.548181 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:52.548159 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:52.548270 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:52.548254 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:52.563007 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:52.562983 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:18:52.577019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:52.576969 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" podStartSLOduration=9.126422919 podStartE2EDuration="28.576951101s" totalImagesPullingTime="19.450528182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:52.575221167 +0000 UTC m=+29.669974246" watchObservedRunningTime="2026-07-01 19:18:52.576951101 +0000 UTC m=+29.671704162" Jul 01 19:18:53.046984 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.046953 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nxldv"] Jul 01 19:18:53.047181 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.047078 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:53.047240 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:53.047173 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:53.050324 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.050299 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l826r"] Jul 01 19:18:53.050448 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.050433 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:53.050557 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:53.050537 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:53.050876 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.050847 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ldg2k"] Jul 01 19:18:53.050964 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.050936 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:53.051034 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:53.051018 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:53.552775 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.552587 2588 generic.go:356] "Generic (PLEG): container finished" podID="4e795316-2daa-467f-8314-9dd493b73da1" containerID="ccc80d318d10c5ef0a63e04ab788a9ce1350ae18efb473b82f2ad4e746bfcf06" exitCode=0 Jul 01 19:18:53.553358 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:53.552674 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerDied","Data":"ccc80d318d10c5ef0a63e04ab788a9ce1350ae18efb473b82f2ad4e746bfcf06"} Jul 01 19:18:54.326256 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:54.326227 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:54.326256 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:54.326263 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:54.326524 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:54.326353 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:54.326524 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:54.326467 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:55.326364 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:55.326337 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:55.326715 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:55.326510 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:55.560227 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:55.560191 2588 generic.go:356] "Generic (PLEG): container finished" podID="4e795316-2daa-467f-8314-9dd493b73da1" containerID="ec1c6d9177fba41db19e38762f60f8c52f0350e6fd638c8586bcd3bf9a34c734" exitCode=0 Jul 01 19:18:55.560375 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:55.560239 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerDied","Data":"ec1c6d9177fba41db19e38762f60f8c52f0350e6fd638c8586bcd3bf9a34c734"} Jul 01 19:18:56.326116 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:56.326087 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:56.326318 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:56.326087 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:56.326318 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:56.326297 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:56.326825 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:56.326334 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:57.014643 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:57.014603 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:57.014849 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.014781 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:57.014909 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.014863 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs podName:8bf9f272-6ec9-4ef4-a740-a0d989d228c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:29.014841525 +0000 UTC m=+66.109594578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs") pod "network-metrics-daemon-ldg2k" (UID: "8bf9f272-6ec9-4ef4-a740-a0d989d228c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:57.115221 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:57.115182 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:57.115402 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:57.115276 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:57.115402 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.115356 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:57.115402 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.115400 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:57.115564 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.115417 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:57.115564 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.115432 2588 projected.go:196] Error preparing data for projected volume kube-api-access-66mc5 for pod openshift-network-diagnostics/network-check-target-l826r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:57.115564 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.115434 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret podName:dd470645-2a19-4679-b59b-23e10114ce44 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:29.115415083 +0000 UTC m=+66.210168123 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret") pod "global-pull-secret-syncer-nxldv" (UID: "dd470645-2a19-4679-b59b-23e10114ce44") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:57.115564 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.115476 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5 podName:eb44450c-aef5-4c8b-9665-ca4b5119c814 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:29.115461403 +0000 UTC m=+66.210214443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-66mc5" (UniqueName: "kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5") pod "network-check-target-l826r" (UID: "eb44450c-aef5-4c8b-9665-ca4b5119c814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:57.326669 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:57.326587 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:57.327266 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:57.326733 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ldg2k" podUID="8bf9f272-6ec9-4ef4-a740-a0d989d228c4" Jul 01 19:18:58.325629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:58.325591 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:18:58.325629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:58.325623 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:18:58.325869 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:58.325704 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l826r" podUID="eb44450c-aef5-4c8b-9665-ca4b5119c814" Jul 01 19:18:58.325869 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:58.325849 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxldv" podUID="dd470645-2a19-4679-b59b-23e10114ce44" Jul 01 19:18:59.174124 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.174092 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeReady" Jul 01 19:18:59.174541 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.174242 2588 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:18:59.231954 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.231822 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-srkql"] Jul 01 19:18:59.262475 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.262436 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jcw8n"] Jul 01 19:18:59.262635 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.262570 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.265433 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.265411 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:18:59.267969 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.267769 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s225c\"" Jul 01 19:18:59.267969 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.267800 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:18:59.278384 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.278360 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jcw8n"] Jul 01 19:18:59.278490 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.278373 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.278574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.278448 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-srkql"] Jul 01 19:18:59.281816 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.281769 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:18:59.281816 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.281769 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:18:59.282144 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.282126 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kpx6j\"" Jul 01 19:18:59.282562 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.282547 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:18:59.326647 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.326616 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:18:59.330715 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.330694 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7lk2\"" Jul 01 19:18:59.330857 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.330720 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:18:59.408146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.408115 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8f5w8"] Jul 01 19:18:59.426412 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.426337 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8f5w8"] Jul 01 19:18:59.426412 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.426394 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.429007 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.428983 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:18:59.429176 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.429162 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:18:59.429486 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.429463 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgxdz\"" Jul 01 19:18:59.429738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.429718 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:18:59.430168 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.430099 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:18:59.431161 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.431134 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7r7h\" (UniqueName: \"kubernetes.io/projected/16dc08f8-a652-4af2-9662-250441aeb70d-kube-api-access-z7r7h\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.431251 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.431167 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16dc08f8-a652-4af2-9662-250441aeb70d-tmp-dir\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.431294 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.431256 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rfjw\" (UniqueName: \"kubernetes.io/projected/cf31ca3d-1613-498b-914f-5d3c9fb3c61f-kube-api-access-8rfjw\") pod \"ingress-canary-jcw8n\" (UID: \"cf31ca3d-1613-498b-914f-5d3c9fb3c61f\") " pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.431334 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.431323 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf31ca3d-1613-498b-914f-5d3c9fb3c61f-cert\") pod \"ingress-canary-jcw8n\" (UID: \"cf31ca3d-1613-498b-914f-5d3c9fb3c61f\") " pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.431398 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.431374 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16dc08f8-a652-4af2-9662-250441aeb70d-config-volume\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.431462 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.431437 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.532141 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532101 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rfjw\" (UniqueName: \"kubernetes.io/projected/cf31ca3d-1613-498b-914f-5d3c9fb3c61f-kube-api-access-8rfjw\") pod \"ingress-canary-jcw8n\" (UID: \"cf31ca3d-1613-498b-914f-5d3c9fb3c61f\") " pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.532291 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532237 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf31ca3d-1613-498b-914f-5d3c9fb3c61f-cert\") pod \"ingress-canary-jcw8n\" (UID: \"cf31ca3d-1613-498b-914f-5d3c9fb3c61f\") " pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.532291 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532264 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.532386 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532292 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16dc08f8-a652-4af2-9662-250441aeb70d-config-volume\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.532386 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532310 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.532386 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532329 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jbn\" (UniqueName: \"kubernetes.io/projected/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-api-access-d2jbn\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.532386 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532348 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7r7h\" (UniqueName: \"kubernetes.io/projected/16dc08f8-a652-4af2-9662-250441aeb70d-kube-api-access-z7r7h\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.532386 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532369 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16dc08f8-a652-4af2-9662-250441aeb70d-tmp-dir\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.532648 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532391 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.532648 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532423 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-crio-socket\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.532648 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532445 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-data-volume\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.532648 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:59.532445 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:59.532648 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:59.532540 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls podName:16dc08f8-a652-4af2-9662-250441aeb70d nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.032520087 +0000 UTC m=+37.127273131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls") pod "dns-default-srkql" (UID: "16dc08f8-a652-4af2-9662-250441aeb70d") : secret "dns-default-metrics-tls" not found Jul 01 19:18:59.532920 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532735 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16dc08f8-a652-4af2-9662-250441aeb70d-tmp-dir\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.532994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.532974 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16dc08f8-a652-4af2-9662-250441aeb70d-config-volume\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.536814 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.536794 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf31ca3d-1613-498b-914f-5d3c9fb3c61f-cert\") pod \"ingress-canary-jcw8n\" (UID: \"cf31ca3d-1613-498b-914f-5d3c9fb3c61f\") " pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.541797 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.541776 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rfjw\" (UniqueName: \"kubernetes.io/projected/cf31ca3d-1613-498b-914f-5d3c9fb3c61f-kube-api-access-8rfjw\") pod \"ingress-canary-jcw8n\" (UID: \"cf31ca3d-1613-498b-914f-5d3c9fb3c61f\") " pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.542271 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.542256 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7r7h\" (UniqueName: \"kubernetes.io/projected/16dc08f8-a652-4af2-9662-250441aeb70d-kube-api-access-z7r7h\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:18:59.587972 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.587941 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jcw8n" Jul 01 19:18:59.633989 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.633788 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jbn\" (UniqueName: \"kubernetes.io/projected/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-api-access-d2jbn\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.634163 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.634020 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.634163 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.634073 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-crio-socket\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.634163 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.634095 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-data-volume\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.634163 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:59.634144 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:18:59.634357 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.634180 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.634357 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:59.634226 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.134204221 +0000 UTC m=+37.228957285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : configmap "kube-rbac-proxy" not found Jul 01 19:18:59.634357 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:59.634273 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:18:59.634357 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:18:59.634323 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.134305314 +0000 UTC m=+37.229058372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : secret "insights-runtime-extractor-tls" not found Jul 01 19:18:59.634357 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.634330 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-crio-socket\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.634529 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.634440 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-data-volume\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.644131 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.644110 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jbn\" (UniqueName: \"kubernetes.io/projected/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-api-access-d2jbn\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:18:59.772679 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:18:59.772636 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jcw8n"] Jul 01 19:18:59.860158 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:18:59.860124 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf31ca3d_1613_498b_914f_5d3c9fb3c61f.slice/crio-540d35f2828a55103153324650f20526be76ebe1c73e147206b86ffa20c94d2b WatchSource:0}: Error finding container 540d35f2828a55103153324650f20526be76ebe1c73e147206b86ffa20c94d2b: Status 404 returned error can't find the container with id 540d35f2828a55103153324650f20526be76ebe1c73e147206b86ffa20c94d2b Jul 01 19:19:00.037345 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.037315 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:19:00.037485 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:00.037465 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:19:00.037544 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:00.037534 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls podName:16dc08f8-a652-4af2-9662-250441aeb70d nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.037518695 +0000 UTC m=+38.132271734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls") pod "dns-default-srkql" (UID: "16dc08f8-a652-4af2-9662-250441aeb70d") : secret "dns-default-metrics-tls" not found Jul 01 19:19:00.138489 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.138454 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:00.138638 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.138533 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:00.138638 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:00.138587 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:00.138638 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:00.138636 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:00.138737 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:00.138652 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.138636608 +0000 UTC m=+38.233389647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : configmap "kube-rbac-proxy" not found Jul 01 19:19:00.138737 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:00.138675 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.138664983 +0000 UTC m=+38.233418022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:00.205761 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.205726 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8"] Jul 01 19:19:00.208399 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.208383 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" Jul 01 19:19:00.210938 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.210916 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 19:19:00.211038 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.210951 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qs5hc\"" Jul 01 19:19:00.211038 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.211000 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 19:19:00.219390 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.219365 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8"] Jul 01 19:19:00.326458 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.326427 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:19:00.326624 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.326427 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:19:00.329635 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.329597 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:19:00.329767 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.329681 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:19:00.329841 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.329824 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:19:00.329877 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.329868 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hpww\"" Jul 01 19:19:00.339797 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.339775 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjw5c\" (UniqueName: \"kubernetes.io/projected/49d8390e-71f6-4017-ba68-e3e58b197e02-kube-api-access-hjw5c\") pod \"migrator-786f9fbc5-m7tf8\" (UID: \"49d8390e-71f6-4017-ba68-e3e58b197e02\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" Jul 01 19:19:00.440836 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.440779 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjw5c\" (UniqueName: \"kubernetes.io/projected/49d8390e-71f6-4017-ba68-e3e58b197e02-kube-api-access-hjw5c\") pod \"migrator-786f9fbc5-m7tf8\" (UID: \"49d8390e-71f6-4017-ba68-e3e58b197e02\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" Jul 01 19:19:00.451546 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.451518 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjw5c\" (UniqueName: \"kubernetes.io/projected/49d8390e-71f6-4017-ba68-e3e58b197e02-kube-api-access-hjw5c\") pod \"migrator-786f9fbc5-m7tf8\" (UID: \"49d8390e-71f6-4017-ba68-e3e58b197e02\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" Jul 01 19:19:00.516691 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.516593 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" Jul 01 19:19:00.574730 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.574690 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jcw8n" event={"ID":"cf31ca3d-1613-498b-914f-5d3c9fb3c61f","Type":"ContainerStarted","Data":"540d35f2828a55103153324650f20526be76ebe1c73e147206b86ffa20c94d2b"} Jul 01 19:19:00.578317 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.578204 2588 generic.go:356] "Generic (PLEG): container finished" podID="4e795316-2daa-467f-8314-9dd493b73da1" containerID="db60a6bf9b29ecbd4125a2134d31c5191e32d2f2181f1d3164ec9d96230f9398" exitCode=0 Jul 01 19:19:00.578317 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.578270 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerDied","Data":"db60a6bf9b29ecbd4125a2134d31c5191e32d2f2181f1d3164ec9d96230f9398"} Jul 01 19:19:00.681077 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:00.680849 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8"] Jul 01 19:19:00.684291 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:00.684258 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d8390e_71f6_4017_ba68_e3e58b197e02.slice/crio-ae8f0d76b02c94059c03dc72e4e97ea49cf55afd443fe030130716a8986bf4c6 WatchSource:0}: Error finding container ae8f0d76b02c94059c03dc72e4e97ea49cf55afd443fe030130716a8986bf4c6: Status 404 returned error can't find the container with id ae8f0d76b02c94059c03dc72e4e97ea49cf55afd443fe030130716a8986bf4c6 Jul 01 19:19:01.047114 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.047074 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:19:01.047289 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:01.047256 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:19:01.047339 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:01.047331 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls podName:16dc08f8-a652-4af2-9662-250441aeb70d nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.047310895 +0000 UTC m=+40.142063936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls") pod "dns-default-srkql" (UID: "16dc08f8-a652-4af2-9662-250441aeb70d") : secret "dns-default-metrics-tls" not found Jul 01 19:19:01.147749 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.147713 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:01.147915 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.147825 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:01.147915 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:01.147837 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:01.147915 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:01.147901 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.14788561 +0000 UTC m=+40.242638670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : configmap "kube-rbac-proxy" not found Jul 01 19:19:01.148087 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:01.147974 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:01.148087 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:01.148034 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.148018372 +0000 UTC m=+40.242771413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:01.377133 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.377105 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lp58q_24b5f333-5271-4beb-a719-e2c8307779d3/dns-node-resolver/0.log" Jul 01 19:19:01.480379 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.480344 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4"] Jul 01 19:19:01.483642 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.483619 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.486277 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.486253 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 19:19:01.487851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.487504 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pvbzj\"" Jul 01 19:19:01.487851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.487524 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 19:19:01.487851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.487544 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 19:19:01.487851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.487830 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 19:19:01.492623 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.492568 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4"] Jul 01 19:19:01.585830 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.585796 2588 generic.go:356] "Generic (PLEG): container finished" podID="4e795316-2daa-467f-8314-9dd493b73da1" containerID="22931534e5101fb7ce8912b3150ca508986876abf2673afaaa2f86e408751aaf" exitCode=0 Jul 01 19:19:01.586031 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.585880 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerDied","Data":"22931534e5101fb7ce8912b3150ca508986876abf2673afaaa2f86e408751aaf"} Jul 01 19:19:01.587948 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.587924 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" event={"ID":"49d8390e-71f6-4017-ba68-e3e58b197e02","Type":"ContainerStarted","Data":"ae8f0d76b02c94059c03dc72e4e97ea49cf55afd443fe030130716a8986bf4c6"} Jul 01 19:19:01.653220 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.653132 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.653220 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.653197 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-signing-key\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.653424 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.653227 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq8v9\" (UniqueName: \"kubernetes.io/projected/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-kube-api-access-dq8v9\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.753973 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.753942 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.754168 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.754117 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-signing-key\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.754168 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.754143 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8v9\" (UniqueName: \"kubernetes.io/projected/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-kube-api-access-dq8v9\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.754724 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.754697 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.757979 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.757958 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-signing-key\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.763860 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.763839 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq8v9\" (UniqueName: \"kubernetes.io/projected/4976e785-6b3c-4b9d-93a1-f9d69fe7abd7-kube-api-access-dq8v9\") pod \"service-ca-7bb4f4bcc7-xlvv4\" (UID: \"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:01.799762 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:01.799731 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" Jul 01 19:19:02.178753 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:02.178724 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b8mrb_6a8caa4a-edc6-4a8f-94a1-9f666d7319a6/node-ca/0.log" Jul 01 19:19:02.706452 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:02.706279 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4"] Jul 01 19:19:02.711237 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:02.711212 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4976e785_6b3c_4b9d_93a1_f9d69fe7abd7.slice/crio-d4c317f7a47f514e48e838263c693abc26c22d2bddd2a33bc05a75213e997307 WatchSource:0}: Error finding container d4c317f7a47f514e48e838263c693abc26c22d2bddd2a33bc05a75213e997307: Status 404 returned error can't find the container with id d4c317f7a47f514e48e838263c693abc26c22d2bddd2a33bc05a75213e997307 Jul 01 19:19:03.066221 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.066185 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:19:03.066390 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:03.066301 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:19:03.066390 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:03.066351 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls podName:16dc08f8-a652-4af2-9662-250441aeb70d nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.066337681 +0000 UTC m=+44.161090721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls") pod "dns-default-srkql" (UID: "16dc08f8-a652-4af2-9662-250441aeb70d") : secret "dns-default-metrics-tls" not found Jul 01 19:19:03.167524 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.167485 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:03.167697 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.167566 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:03.167697 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:03.167613 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:03.167697 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:03.167679 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.167663026 +0000 UTC m=+44.262416068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : configmap "kube-rbac-proxy" not found Jul 01 19:19:03.167697 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:03.167688 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:03.167845 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:03.167731 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.167719975 +0000 UTC m=+44.262473014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:03.603865 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.603830 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jcw8n" event={"ID":"cf31ca3d-1613-498b-914f-5d3c9fb3c61f","Type":"ContainerStarted","Data":"6d212f04965ab86717901ca390e389250607439a1aead95e35d77c6fd30cdc03"} Jul 01 19:19:03.605966 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.605929 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" event={"ID":"49d8390e-71f6-4017-ba68-e3e58b197e02","Type":"ContainerStarted","Data":"feecbcb841e42195b562c40c4b2493ca6819ec582d1ae7303b30d56553948ade"} Jul 01 19:19:03.606103 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.605985 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" event={"ID":"49d8390e-71f6-4017-ba68-e3e58b197e02","Type":"ContainerStarted","Data":"2cabe0f8cb86f94e06406559c61e587a1334bfde3c4563db27c02609caf9665b"} Jul 01 19:19:03.610001 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.609971 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" event={"ID":"4e795316-2daa-467f-8314-9dd493b73da1","Type":"ContainerStarted","Data":"9c2c4fee59928092d7f50527c3ba3a2ebee1c80b78523a4457efeccebce70c0f"} Jul 01 19:19:03.611350 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.611324 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" event={"ID":"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7","Type":"ContainerStarted","Data":"d4c317f7a47f514e48e838263c693abc26c22d2bddd2a33bc05a75213e997307"} Jul 01 19:19:03.619921 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.619873 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jcw8n" podStartSLOduration=1.961189361 podStartE2EDuration="4.619856455s" totalImagesPullingTime="2.658667094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:03.619697632 +0000 UTC m=+40.714450714" watchObservedRunningTime="2026-07-01 19:19:03.619856455 +0000 UTC m=+40.714609517" Jul 01 19:19:03.645685 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.645632 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l2rxc" podStartSLOduration=9.009770827 podStartE2EDuration="39.645610261s" totalImagesPullingTime="30.635839434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:03.644656175 +0000 UTC m=+40.739409261" watchObservedRunningTime="2026-07-01 19:19:03.645610261 +0000 UTC m=+40.740363324" Jul 01 19:19:03.661672 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:03.661617 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-m7tf8" podStartSLOduration=1.809727977 podStartE2EDuration="3.661596679s" totalImagesPullingTime="1.851868702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:03.66056759 +0000 UTC m=+40.755320652" watchObservedRunningTime="2026-07-01 19:19:03.661596679 +0000 UTC m=+40.756349741" Jul 01 19:19:05.618439 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:05.618354 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" event={"ID":"4976e785-6b3c-4b9d-93a1-f9d69fe7abd7","Type":"ContainerStarted","Data":"7b9ec407ca217a8e041cc9e39cde0e74c7e7b68c22bc345f9392e69e81e3a962"} Jul 01 19:19:05.634387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:05.634330 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-xlvv4" podStartSLOduration=2.169283009 podStartE2EDuration="4.634315615s" totalImagesPullingTime="2.465032606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:05.632923564 +0000 UTC m=+42.727676616" watchObservedRunningTime="2026-07-01 19:19:05.634315615 +0000 UTC m=+42.729068675" Jul 01 19:19:07.101633 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:07.101586 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:19:07.102129 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:07.101811 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:19:07.102129 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:07.101903 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls podName:16dc08f8-a652-4af2-9662-250441aeb70d nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.10188231 +0000 UTC m=+52.196635363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls") pod "dns-default-srkql" (UID: "16dc08f8-a652-4af2-9662-250441aeb70d") : secret "dns-default-metrics-tls" not found Jul 01 19:19:07.202481 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:07.202451 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:07.202641 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:07.202513 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:07.202641 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:07.202596 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:07.202641 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:07.202632 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:07.202778 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:07.202667 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.202647404 +0000 UTC m=+52.297400450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : configmap "kube-rbac-proxy" not found Jul 01 19:19:07.202778 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:07.202689 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.202677868 +0000 UTC m=+52.297430915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.156197 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.156149 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:19:15.159722 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.159692 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dc08f8-a652-4af2-9662-250441aeb70d-metrics-tls\") pod \"dns-default-srkql\" (UID: \"16dc08f8-a652-4af2-9662-250441aeb70d\") " pod="openshift-dns/dns-default-srkql" Jul 01 19:19:15.173663 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.173639 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-srkql" Jul 01 19:19:15.256532 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.256500 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:15.256700 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.256566 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:15.256700 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:15.256674 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.256807 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:15.256721 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls podName:1f63a7ba-95bf-4bc7-89e6-6318875c6fde nodeName:}" failed. No retries permitted until 2026-07-01 19:19:31.256709432 +0000 UTC m=+68.351462471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8f5w8" (UID: "1f63a7ba-95bf-4bc7-89e6-6318875c6fde") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.257387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.257364 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:15.309438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.309407 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-srkql"] Jul 01 19:19:15.312816 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:15.312793 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16dc08f8_a652_4af2_9662_250441aeb70d.slice/crio-c7bc65eb31a79ec6c393b841a2d817a38542aa676d9f05ef8a40970a1acde8e7 WatchSource:0}: Error finding container c7bc65eb31a79ec6c393b841a2d817a38542aa676d9f05ef8a40970a1acde8e7: Status 404 returned error can't find the container with id c7bc65eb31a79ec6c393b841a2d817a38542aa676d9f05ef8a40970a1acde8e7 Jul 01 19:19:15.645475 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:15.645444 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-srkql" event={"ID":"16dc08f8-a652-4af2-9662-250441aeb70d","Type":"ContainerStarted","Data":"c7bc65eb31a79ec6c393b841a2d817a38542aa676d9f05ef8a40970a1acde8e7"} Jul 01 19:19:17.653501 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:17.653467 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-srkql" event={"ID":"16dc08f8-a652-4af2-9662-250441aeb70d","Type":"ContainerStarted","Data":"1e23e785101747d3d1bb971080b4f653af77fd53cb839ff78b0b0dc97fea6f07"} Jul 01 19:19:18.658248 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:18.658212 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-srkql" event={"ID":"16dc08f8-a652-4af2-9662-250441aeb70d","Type":"ContainerStarted","Data":"9a1413c4717d0cdbc7e5f3e7aa8f5710825a28e3162212c7c30456144ef01776"} Jul 01 19:19:18.658635 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:18.658325 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-srkql" Jul 01 19:19:18.675423 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:18.675369 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-srkql" podStartSLOduration=17.606584734 podStartE2EDuration="19.675350124s" totalImagesPullingTime="2.06876539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:18.675082828 +0000 UTC m=+55.769835896" watchObservedRunningTime="2026-07-01 19:19:18.675350124 +0000 UTC m=+55.770103187" Jul 01 19:19:23.318511 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.318480 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl"] Jul 01 19:19:23.320987 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.320960 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.324128 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.324107 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-z22ds\"" Jul 01 19:19:23.325162 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.325145 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 19:19:23.325293 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.325163 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 19:19:23.325427 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.325294 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 19:19:23.325427 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.325316 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 19:19:23.336737 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.336718 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl"] Jul 01 19:19:23.417696 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.417663 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnkp\" (UniqueName: \"kubernetes.io/projected/c9fafc0a-e1bd-48fe-bc36-91f66374fe0f-kube-api-access-8pnkp\") pod \"managed-serviceaccount-addon-agent-84477ccb86-297bl\" (UID: \"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.417856 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.417766 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9fafc0a-e1bd-48fe-bc36-91f66374fe0f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84477ccb86-297bl\" (UID: \"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.418380 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.418363 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-hf9hv"] Jul 01 19:19:23.420053 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.420039 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:23.421429 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.421408 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67654b9bc-jss5j"] Jul 01 19:19:23.422574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.422548 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:19:23.422657 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.422594 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:19:23.422657 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.422596 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w4rn5\"" Jul 01 19:19:23.422935 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.422919 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.425439 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.425421 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:19:23.425584 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.425566 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:19:23.425689 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.425674 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:19:23.425866 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.425851 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jxkfq\"" Jul 01 19:19:23.429865 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.429844 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:19:23.434745 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.434727 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-hf9hv"] Jul 01 19:19:23.452049 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.452029 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67654b9bc-jss5j"] Jul 01 19:19:23.518284 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518251 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnkp\" (UniqueName: \"kubernetes.io/projected/c9fafc0a-e1bd-48fe-bc36-91f66374fe0f-kube-api-access-8pnkp\") pod \"managed-serviceaccount-addon-agent-84477ccb86-297bl\" (UID: \"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.518467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518308 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-registry-certificates\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518331 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-installation-pull-secrets\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518362 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9fafc0a-e1bd-48fe-bc36-91f66374fe0f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84477ccb86-297bl\" (UID: \"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.518467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518388 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6hv\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-kube-api-access-pk6hv\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518467 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518406 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl59w\" (UniqueName: \"kubernetes.io/projected/073a15ee-4a69-4217-9f1d-3580fef42728-kube-api-access-wl59w\") pod \"downloads-5499b6fb8f-hf9hv\" (UID: \"073a15ee-4a69-4217-9f1d-3580fef42728\") " pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:23.518702 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518515 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-image-registry-private-configuration\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518702 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518538 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-registry-tls\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518702 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518554 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-ca-trust-extracted\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518702 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518571 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-bound-sa-token\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.518702 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.518674 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-trusted-ca\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.520813 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.520795 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9fafc0a-e1bd-48fe-bc36-91f66374fe0f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84477ccb86-297bl\" (UID: \"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.528003 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.527981 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnkp\" (UniqueName: \"kubernetes.io/projected/c9fafc0a-e1bd-48fe-bc36-91f66374fe0f-kube-api-access-8pnkp\") pod \"managed-serviceaccount-addon-agent-84477ccb86-297bl\" (UID: \"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.619594 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619518 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-trusted-ca\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.619747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619611 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-registry-certificates\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.619747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619632 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-installation-pull-secrets\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.619747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619652 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6hv\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-kube-api-access-pk6hv\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.619747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619676 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl59w\" (UniqueName: \"kubernetes.io/projected/073a15ee-4a69-4217-9f1d-3580fef42728-kube-api-access-wl59w\") pod \"downloads-5499b6fb8f-hf9hv\" (UID: \"073a15ee-4a69-4217-9f1d-3580fef42728\") " pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:23.619964 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619941 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-image-registry-private-configuration\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.620140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.619984 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-registry-tls\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.620140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.620011 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-ca-trust-extracted\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.620140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.620037 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-bound-sa-token\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.620384 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.620365 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-ca-trust-extracted\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.620522 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.620492 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-registry-certificates\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.620627 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.620536 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-trusted-ca\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.622331 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.622307 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-installation-pull-secrets\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.622409 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.622368 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-registry-tls\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.622409 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.622387 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-image-registry-private-configuration\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.631476 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.631450 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-bound-sa-token\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.631632 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.631613 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6hv\" (UniqueName: \"kubernetes.io/projected/89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c-kube-api-access-pk6hv\") pod \"image-registry-67654b9bc-jss5j\" (UID: \"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c\") " pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.637762 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.637740 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl59w\" (UniqueName: \"kubernetes.io/projected/073a15ee-4a69-4217-9f1d-3580fef42728-kube-api-access-wl59w\") pod \"downloads-5499b6fb8f-hf9hv\" (UID: \"073a15ee-4a69-4217-9f1d-3580fef42728\") " pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:23.643985 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.643968 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" Jul 01 19:19:23.729638 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.729610 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:23.735515 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.735491 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:23.767094 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.767043 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl"] Jul 01 19:19:23.770778 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:23.770745 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9fafc0a_e1bd_48fe_bc36_91f66374fe0f.slice/crio-78b89043cad8d76dc35e7489e9ed593ea1488964dd956c7afca90d2ce6183a71 WatchSource:0}: Error finding container 78b89043cad8d76dc35e7489e9ed593ea1488964dd956c7afca90d2ce6183a71: Status 404 returned error can't find the container with id 78b89043cad8d76dc35e7489e9ed593ea1488964dd956c7afca90d2ce6183a71 Jul 01 19:19:23.877750 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.877714 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-hf9hv"] Jul 01 19:19:23.881417 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:23.881394 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073a15ee_4a69_4217_9f1d_3580fef42728.slice/crio-83bd9855009cc89c7b3becd14d6debffae48057638a9a094daf694fd7d65e9f5 WatchSource:0}: Error finding container 83bd9855009cc89c7b3becd14d6debffae48057638a9a094daf694fd7d65e9f5: Status 404 returned error can't find the container with id 83bd9855009cc89c7b3becd14d6debffae48057638a9a094daf694fd7d65e9f5 Jul 01 19:19:23.899448 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.899430 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67654b9bc-jss5j"] Jul 01 19:19:23.901595 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:23.901571 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f60ab2_0cb3_4fdd_b82d_22a3ae3d072c.slice/crio-e3344dbd1b7fa057b179a59df288224c771657ebf5119c0f05409ffb58839ecf WatchSource:0}: Error finding container e3344dbd1b7fa057b179a59df288224c771657ebf5119c0f05409ffb58839ecf: Status 404 returned error can't find the container with id e3344dbd1b7fa057b179a59df288224c771657ebf5119c0f05409ffb58839ecf Jul 01 19:19:23.977398 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.977376 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc556858-f2jnj"] Jul 01 19:19:23.978952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.978936 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:23.982146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.982126 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:19:23.982262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.982130 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:19:23.982378 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.982366 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-472lm\"" Jul 01 19:19:23.982670 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.982653 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:19:23.982846 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.982835 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:19:23.983422 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.983406 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:19:23.996699 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:23.996680 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc556858-f2jnj"] Jul 01 19:19:24.022890 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.022867 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvb7f\" (UniqueName: \"kubernetes.io/projected/eefcab7b-f2f1-4660-8607-411fc69ab11e-kube-api-access-qvb7f\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.022984 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.022919 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-config\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.023038 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.023000 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-oauth-config\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.023111 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.023036 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-serving-cert\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.023111 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.023075 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-oauth-serving-cert\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.023190 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.023114 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-service-ca\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124053 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124022 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvb7f\" (UniqueName: \"kubernetes.io/projected/eefcab7b-f2f1-4660-8607-411fc69ab11e-kube-api-access-qvb7f\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124235 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124104 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-config\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124235 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124164 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-oauth-config\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124235 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124190 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-serving-cert\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124235 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124216 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-oauth-serving-cert\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124435 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124375 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-service-ca\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.124904 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124853 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-config\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.125019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124904 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-oauth-serving-cert\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.125019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.124956 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-service-ca\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.126545 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.126525 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-oauth-config\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.126757 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.126736 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-serving-cert\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.132950 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.132899 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvb7f\" (UniqueName: \"kubernetes.io/projected/eefcab7b-f2f1-4660-8607-411fc69ab11e-kube-api-access-qvb7f\") pod \"console-bc556858-f2jnj\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.287609 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.287554 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:24.417549 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:24.417519 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefcab7b_f2f1_4660_8607_411fc69ab11e.slice/crio-5801af87fe29184305063ad4a545cec9da895f6a443e7f7c43ba1b4cbd20a1b9 WatchSource:0}: Error finding container 5801af87fe29184305063ad4a545cec9da895f6a443e7f7c43ba1b4cbd20a1b9: Status 404 returned error can't find the container with id 5801af87fe29184305063ad4a545cec9da895f6a443e7f7c43ba1b4cbd20a1b9 Jul 01 19:19:24.418201 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.418178 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc556858-f2jnj"] Jul 01 19:19:24.565984 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.565956 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5qtk" Jul 01 19:19:24.677857 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.677772 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc556858-f2jnj" event={"ID":"eefcab7b-f2f1-4660-8607-411fc69ab11e","Type":"ContainerStarted","Data":"5801af87fe29184305063ad4a545cec9da895f6a443e7f7c43ba1b4cbd20a1b9"} Jul 01 19:19:24.679113 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.679083 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-hf9hv" event={"ID":"073a15ee-4a69-4217-9f1d-3580fef42728","Type":"ContainerStarted","Data":"83bd9855009cc89c7b3becd14d6debffae48057638a9a094daf694fd7d65e9f5"} Jul 01 19:19:24.680646 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.680621 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" event={"ID":"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c","Type":"ContainerStarted","Data":"72e6579848d10a37a7540faaada46ce5d1f18824cdb99bc85fdf7232282edd62"} Jul 01 19:19:24.680742 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.680661 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" event={"ID":"89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c","Type":"ContainerStarted","Data":"e3344dbd1b7fa057b179a59df288224c771657ebf5119c0f05409ffb58839ecf"} Jul 01 19:19:24.680805 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.680744 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:24.682557 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.682530 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" event={"ID":"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f","Type":"ContainerStarted","Data":"78b89043cad8d76dc35e7489e9ed593ea1488964dd956c7afca90d2ce6183a71"} Jul 01 19:19:24.705880 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:24.705832 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" podStartSLOduration=1.7058184029999999 podStartE2EDuration="1.705818403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:24.704825502 +0000 UTC m=+61.799578592" watchObservedRunningTime="2026-07-01 19:19:24.705818403 +0000 UTC m=+61.800571463" Jul 01 19:19:25.939333 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:25.938277 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp"] Jul 01 19:19:25.945529 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:25.944494 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:25.948449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:25.948429 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k2fm5\"" Jul 01 19:19:25.949043 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:25.949021 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 19:19:25.955814 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:25.955277 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp"] Jul 01 19:19:26.041096 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:26.040974 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed89f935-9405-4bc6-a57f-a5ba3aaab629-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-mgcxp\" (UID: \"ed89f935-9405-4bc6-a57f-a5ba3aaab629\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:26.142118 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:26.142004 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed89f935-9405-4bc6-a57f-a5ba3aaab629-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-mgcxp\" (UID: \"ed89f935-9405-4bc6-a57f-a5ba3aaab629\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:26.145179 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:26.145134 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed89f935-9405-4bc6-a57f-a5ba3aaab629-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-mgcxp\" (UID: \"ed89f935-9405-4bc6-a57f-a5ba3aaab629\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:26.258411 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:26.258328 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:28.443792 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:28.443756 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp"] Jul 01 19:19:28.448958 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:28.448925 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded89f935_9405_4bc6_a57f_a5ba3aaab629.slice/crio-54ae33015e707621041620d23138dc1c75690f3a9051f07218997e2f9d6ab9a4 WatchSource:0}: Error finding container 54ae33015e707621041620d23138dc1c75690f3a9051f07218997e2f9d6ab9a4: Status 404 returned error can't find the container with id 54ae33015e707621041620d23138dc1c75690f3a9051f07218997e2f9d6ab9a4 Jul 01 19:19:28.663686 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:28.663657 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-srkql" Jul 01 19:19:28.705868 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:28.705828 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc556858-f2jnj" event={"ID":"eefcab7b-f2f1-4660-8607-411fc69ab11e","Type":"ContainerStarted","Data":"30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00"} Jul 01 19:19:28.707237 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:28.707211 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" event={"ID":"ed89f935-9405-4bc6-a57f-a5ba3aaab629","Type":"ContainerStarted","Data":"54ae33015e707621041620d23138dc1c75690f3a9051f07218997e2f9d6ab9a4"} Jul 01 19:19:28.708863 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:28.708836 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" event={"ID":"c9fafc0a-e1bd-48fe-bc36-91f66374fe0f","Type":"ContainerStarted","Data":"4032a5b7254cdfe50fb84c86cf93c149af113487ecb60469ea05d09052845e8b"} Jul 01 19:19:28.729839 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:28.729788 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bc556858-f2jnj" podStartSLOduration=1.8381035799999998 podStartE2EDuration="5.729771098s" totalImagesPullingTime="3.891667518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:28.728488177 +0000 UTC m=+65.823241255" watchObservedRunningTime="2026-07-01 19:19:28.729771098 +0000 UTC m=+65.824524159" Jul 01 19:19:29.072124 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.072010 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:19:29.074819 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.074796 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:19:29.085441 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.085407 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bf9f272-6ec9-4ef4-a740-a0d989d228c4-metrics-certs\") pod \"network-metrics-daemon-ldg2k\" (UID: \"8bf9f272-6ec9-4ef4-a740-a0d989d228c4\") " pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:19:29.173223 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.173186 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:19:29.173383 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.173243 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:19:29.175760 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.175743 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:19:29.175804 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.175781 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:19:29.185987 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.185963 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd470645-2a19-4679-b59b-23e10114ce44-original-pull-secret\") pod \"global-pull-secret-syncer-nxldv\" (UID: \"dd470645-2a19-4679-b59b-23e10114ce44\") " pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:19:29.186115 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.186102 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:19:29.196785 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.196758 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66mc5\" (UniqueName: \"kubernetes.io/projected/eb44450c-aef5-4c8b-9665-ca4b5119c814-kube-api-access-66mc5\") pod \"network-check-target-l826r\" (UID: \"eb44450c-aef5-4c8b-9665-ca4b5119c814\") " pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:19:29.339735 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.339664 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7lk2\"" Jul 01 19:19:29.348128 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.348104 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ldg2k" Jul 01 19:19:29.438004 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.437976 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hpww\"" Jul 01 19:19:29.440425 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.440397 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxldv" Jul 01 19:19:29.446040 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.446016 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:19:29.490638 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.490543 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84477ccb86-297bl" podStartSLOduration=1.958638428 podStartE2EDuration="6.490515943s" totalImagesPullingTime="4.531877515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:28.747164432 +0000 UTC m=+65.841917503" watchObservedRunningTime="2026-07-01 19:19:29.490515943 +0000 UTC m=+66.585269006" Jul 01 19:19:29.491758 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.491686 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ldg2k"] Jul 01 19:19:29.495158 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:29.495128 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf9f272_6ec9_4ef4_a740_a0d989d228c4.slice/crio-cbd142548c6ecc60e725e713748a85ffc8be60605dcc2e21ab1fddea668502ea WatchSource:0}: Error finding container cbd142548c6ecc60e725e713748a85ffc8be60605dcc2e21ab1fddea668502ea: Status 404 returned error can't find the container with id cbd142548c6ecc60e725e713748a85ffc8be60605dcc2e21ab1fddea668502ea Jul 01 19:19:29.617432 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.617028 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l826r"] Jul 01 19:19:29.621156 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:29.620935 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb44450c_aef5_4c8b_9665_ca4b5119c814.slice/crio-d2d0efd55f51afcb2a6432b2098bf9a95c0987c54e11e2d02268a00ffc961161 WatchSource:0}: Error finding container d2d0efd55f51afcb2a6432b2098bf9a95c0987c54e11e2d02268a00ffc961161: Status 404 returned error can't find the container with id d2d0efd55f51afcb2a6432b2098bf9a95c0987c54e11e2d02268a00ffc961161 Jul 01 19:19:29.635045 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.635011 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nxldv"] Jul 01 19:19:29.639614 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:29.639573 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd470645_2a19_4679_b59b_23e10114ce44.slice/crio-2f406ecb102889f086c8dab00c969af22e2246335d93fa19fdd23e8b159d408b WatchSource:0}: Error finding container 2f406ecb102889f086c8dab00c969af22e2246335d93fa19fdd23e8b159d408b: Status 404 returned error can't find the container with id 2f406ecb102889f086c8dab00c969af22e2246335d93fa19fdd23e8b159d408b Jul 01 19:19:29.713716 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.713680 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nxldv" event={"ID":"dd470645-2a19-4679-b59b-23e10114ce44","Type":"ContainerStarted","Data":"2f406ecb102889f086c8dab00c969af22e2246335d93fa19fdd23e8b159d408b"} Jul 01 19:19:29.714981 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.714947 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ldg2k" event={"ID":"8bf9f272-6ec9-4ef4-a740-a0d989d228c4","Type":"ContainerStarted","Data":"cbd142548c6ecc60e725e713748a85ffc8be60605dcc2e21ab1fddea668502ea"} Jul 01 19:19:29.716640 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:29.716585 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l826r" event={"ID":"eb44450c-aef5-4c8b-9665-ca4b5119c814","Type":"ContainerStarted","Data":"d2d0efd55f51afcb2a6432b2098bf9a95c0987c54e11e2d02268a00ffc961161"} Jul 01 19:19:30.727358 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:30.724602 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" event={"ID":"ed89f935-9405-4bc6-a57f-a5ba3aaab629","Type":"ContainerStarted","Data":"141691629be396a95ffc6a5542f62dff688198544ef4f6f411927e249591b1eb"} Jul 01 19:19:30.727949 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:30.727890 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:30.733023 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:30.732999 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" Jul 01 19:19:30.747677 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:30.747610 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mgcxp" podStartSLOduration=4.077557344 podStartE2EDuration="5.747582482s" totalImagesPullingTime="1.670025138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:30.746353593 +0000 UTC m=+67.841106656" watchObservedRunningTime="2026-07-01 19:19:30.747582482 +0000 UTC m=+67.842335544" Jul 01 19:19:31.035996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.035431 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-cx428"] Jul 01 19:19:31.038971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.038947 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.046286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.045814 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6r2xk\"" Jul 01 19:19:31.046286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.045851 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 19:19:31.046286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.045872 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:19:31.046286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.046086 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:19:31.046286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.046129 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:19:31.046286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.046220 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 19:19:31.053917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.053851 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-cx428"] Jul 01 19:19:31.090969 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.090939 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqwt\" (UniqueName: \"kubernetes.io/projected/e6851508-b4b2-4948-8566-1bf0e2e1385b-kube-api-access-nsqwt\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.091097 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.090985 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.091097 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.091018 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6851508-b4b2-4948-8566-1bf0e2e1385b-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.091097 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.091051 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.192269 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.192229 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqwt\" (UniqueName: \"kubernetes.io/projected/e6851508-b4b2-4948-8566-1bf0e2e1385b-kube-api-access-nsqwt\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.192457 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.192283 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.192457 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.192316 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6851508-b4b2-4948-8566-1bf0e2e1385b-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.192457 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.192351 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.194258 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:31.192978 2588 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 19:19:31.194258 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:31.193052 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-tls podName:e6851508-b4b2-4948-8566-1bf0e2e1385b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:31.693031522 +0000 UTC m=+68.787784581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-cx428" (UID: "e6851508-b4b2-4948-8566-1bf0e2e1385b") : secret "prometheus-operator-tls" not found Jul 01 19:19:31.194258 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.194196 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6851508-b4b2-4948-8566-1bf0e2e1385b-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.195976 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.195947 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.203756 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.203691 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqwt\" (UniqueName: \"kubernetes.io/projected/e6851508-b4b2-4948-8566-1bf0e2e1385b-kube-api-access-nsqwt\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.293137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.292962 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:31.296728 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.296659 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f63a7ba-95bf-4bc7-89e6-6318875c6fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f5w8\" (UID: \"1f63a7ba-95bf-4bc7-89e6-6318875c6fde\") " pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:31.541041 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.541006 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgxdz\"" Jul 01 19:19:31.548676 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.548381 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8f5w8" Jul 01 19:19:31.697880 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.697790 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.701983 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.701944 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6851508-b4b2-4948-8566-1bf0e2e1385b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-cx428\" (UID: \"e6851508-b4b2-4948-8566-1bf0e2e1385b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:31.732436 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.732396 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ldg2k" event={"ID":"8bf9f272-6ec9-4ef4-a740-a0d989d228c4","Type":"ContainerStarted","Data":"b6b460740eba0c9729edef9fe02f071df8005ccad02cfa471651e7578857e0f8"} Jul 01 19:19:31.732930 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.732450 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ldg2k" event={"ID":"8bf9f272-6ec9-4ef4-a740-a0d989d228c4","Type":"ContainerStarted","Data":"ff8f6f8d64c60244524785ca082465a94d68b4fb2333bd9b0bbfac4267fadae0"} Jul 01 19:19:31.750030 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.749947 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8f5w8"] Jul 01 19:19:31.757676 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:31.757625 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f63a7ba_95bf_4bc7_89e6_6318875c6fde.slice/crio-dacf522d73bcb9480d0d8d48e413f179a367967cd2492ad831674bca3faf34a0 WatchSource:0}: Error finding container dacf522d73bcb9480d0d8d48e413f179a367967cd2492ad831674bca3faf34a0: Status 404 returned error can't find the container with id dacf522d73bcb9480d0d8d48e413f179a367967cd2492ad831674bca3faf34a0 Jul 01 19:19:31.777620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.776865 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ldg2k" podStartSLOduration=66.440878891 podStartE2EDuration="1m7.776842828s" totalImagesPullingTime="1.335963937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:31.775666861 +0000 UTC m=+68.870419943" watchObservedRunningTime="2026-07-01 19:19:31.776842828 +0000 UTC m=+68.871595891" Jul 01 19:19:31.970841 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:31.970805 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" Jul 01 19:19:32.738824 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:32.738750 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f5w8" event={"ID":"1f63a7ba-95bf-4bc7-89e6-6318875c6fde","Type":"ContainerStarted","Data":"dacf522d73bcb9480d0d8d48e413f179a367967cd2492ad831674bca3faf34a0"} Jul 01 19:19:33.632348 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:33.632308 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-cx428"] Jul 01 19:19:33.636290 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:33.636254 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6851508_b4b2_4948_8566_1bf0e2e1385b.slice/crio-44939f3164981480c4cf66a03a3537d1d56bd7fff962e767a73cc0ea8ac92975 WatchSource:0}: Error finding container 44939f3164981480c4cf66a03a3537d1d56bd7fff962e767a73cc0ea8ac92975: Status 404 returned error can't find the container with id 44939f3164981480c4cf66a03a3537d1d56bd7fff962e767a73cc0ea8ac92975 Jul 01 19:19:33.744734 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:33.744655 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" event={"ID":"e6851508-b4b2-4948-8566-1bf0e2e1385b","Type":"ContainerStarted","Data":"44939f3164981480c4cf66a03a3537d1d56bd7fff962e767a73cc0ea8ac92975"} Jul 01 19:19:34.288174 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:34.288124 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:34.289493 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:34.289467 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:34.296634 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:34.296510 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:34.753449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:34.753423 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:19:35.753515 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:35.753479 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l826r" event={"ID":"eb44450c-aef5-4c8b-9665-ca4b5119c814","Type":"ContainerStarted","Data":"b4196299ab5348f2309a62a1787ef7ac235050ad06fb74e256cad1d383008566"} Jul 01 19:19:35.769974 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:35.769929 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l826r" podStartSLOduration=65.765258084 podStartE2EDuration="1m11.769914351s" totalImagesPullingTime="6.004656267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:35.769077643 +0000 UTC m=+72.863830725" watchObservedRunningTime="2026-07-01 19:19:35.769914351 +0000 UTC m=+72.864667415" Jul 01 19:19:36.760498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:36.760461 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nxldv" event={"ID":"dd470645-2a19-4679-b59b-23e10114ce44","Type":"ContainerStarted","Data":"380a7aac51fa25d76679ccbcd98e04394380615702c902eac8e03c684d51544f"} Jul 01 19:19:36.761158 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:36.760773 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:19:36.777729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:36.777610 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nxldv" podStartSLOduration=66.421213275 podStartE2EDuration="1m12.777590891s" totalImagesPullingTime="6.356377616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:36.777120071 +0000 UTC m=+73.871873156" watchObservedRunningTime="2026-07-01 19:19:36.777590891 +0000 UTC m=+73.872343953" Jul 01 19:19:41.536147 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:41.536115 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc556858-f2jnj"] Jul 01 19:19:45.693171 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:45.693146 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67654b9bc-jss5j" Jul 01 19:19:47.804705 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.804525 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f5w8" event={"ID":"1f63a7ba-95bf-4bc7-89e6-6318875c6fde","Type":"ContainerStarted","Data":"598181b0d59eb32f4ab92b9e960add9c52ed4f2d172e62900c26f910dc8d7a07"} Jul 01 19:19:47.806868 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.806829 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" event={"ID":"e6851508-b4b2-4948-8566-1bf0e2e1385b","Type":"ContainerStarted","Data":"33a7ca4048626e0e5a0999c967a097e262b158145686ba58b4c1d8800c095c8f"} Jul 01 19:19:47.807018 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.806895 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" event={"ID":"e6851508-b4b2-4948-8566-1bf0e2e1385b","Type":"ContainerStarted","Data":"e83945fa76f4e93dfcc1af784c508f60c01021c24153713aabb16e8d06360926"} Jul 01 19:19:47.808665 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.808636 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-hf9hv" event={"ID":"073a15ee-4a69-4217-9f1d-3580fef42728","Type":"ContainerStarted","Data":"9d227a5fc38b321eb9eae632f038ef3b3e5f6d304f801bc7df77c7a0f90b73a7"} Jul 01 19:19:47.808879 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.808856 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:47.828579 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.828537 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-hf9hv" Jul 01 19:19:47.829994 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.829949 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-cx428" podStartSLOduration=3.417976064 podStartE2EDuration="16.829932071s" totalImagesPullingTime="13.411956007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:47.828694601 +0000 UTC m=+84.923447674" watchObservedRunningTime="2026-07-01 19:19:47.829932071 +0000 UTC m=+84.924685133" Jul 01 19:19:47.845128 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:47.845073 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-hf9hv" podStartSLOduration=1.677461034 podStartE2EDuration="24.845036489s" totalImagesPullingTime="23.167575455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:47.843578002 +0000 UTC m=+84.938331064" watchObservedRunningTime="2026-07-01 19:19:47.845036489 +0000 UTC m=+84.939789551" Jul 01 19:19:49.370399 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.370365 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nbxvg"] Jul 01 19:19:49.390547 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.390521 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.394505 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.394470 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-w7zhz"] Jul 01 19:19:49.399799 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.398829 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:19:49.399799 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.399475 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pkv94\"" Jul 01 19:19:49.407116 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.405700 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:19:49.407116 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.405915 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:19:49.412399 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.412378 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.416851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.416255 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 19:19:49.416851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.416464 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:19:49.416851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.416634 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fh4pz\"" Jul 01 19:19:49.418526 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.418335 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 19:19:49.423623 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.423596 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-w7zhz"] Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559676 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-wtmp\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559726 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559756 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559789 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559814 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h6tn\" (UniqueName: \"kubernetes.io/projected/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-api-access-7h6tn\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559858 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559882 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-metrics-client-ca\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559913 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-root\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559937 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559970 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2k8t\" (UniqueName: \"kubernetes.io/projected/edc1a253-5c85-4436-98e2-6b5cbb203339-kube-api-access-l2k8t\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.559996 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.560027 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-tls\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.560090 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-textfile\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.560117 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-sys\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.560307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.560139 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edc1a253-5c85-4436-98e2-6b5cbb203339-metrics-client-ca\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.660904 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-wtmp\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.660955 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.660984 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661041 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h6tn\" (UniqueName: \"kubernetes.io/projected/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-api-access-7h6tn\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661105 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661131 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-metrics-client-ca\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661160 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-root\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661183 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661213 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2k8t\" (UniqueName: \"kubernetes.io/projected/edc1a253-5c85-4436-98e2-6b5cbb203339-kube-api-access-l2k8t\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661239 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661269 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-tls\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661308 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-textfile\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661332 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-sys\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661354 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edc1a253-5c85-4436-98e2-6b5cbb203339-metrics-client-ca\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.664937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.661983 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edc1a253-5c85-4436-98e2-6b5cbb203339-metrics-client-ca\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.662149 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-wtmp\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:49.662243 2588 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:49.662302 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-tls podName:3ae90b05-e72a-45c6-a0e6-1530decd9ba7 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:50.162282341 +0000 UTC m=+87.257035388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-w7zhz" (UID: "3ae90b05-e72a-45c6-a0e6-1530decd9ba7") : secret "kube-state-metrics-tls" not found Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.662801 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.664035 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.664593 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-metrics-client-ca\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.664648 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-root\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.665341 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-textfile\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:49.665657 2588 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:19:49.665711 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-tls podName:edc1a253-5c85-4436-98e2-6b5cbb203339 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:50.165694188 +0000 UTC m=+87.260447232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-tls") pod "node-exporter-nbxvg" (UID: "edc1a253-5c85-4436-98e2-6b5cbb203339") : secret "node-exporter-tls" not found Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.665857 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edc1a253-5c85-4436-98e2-6b5cbb203339-sys\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.666875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.665960 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.667581 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.667520 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.672085 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.671491 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.678031 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.678001 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2k8t\" (UniqueName: \"kubernetes.io/projected/edc1a253-5c85-4436-98e2-6b5cbb203339-kube-api-access-l2k8t\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:49.678663 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.678626 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h6tn\" (UniqueName: \"kubernetes.io/projected/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-api-access-7h6tn\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:49.822925 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:49.822869 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f5w8" event={"ID":"1f63a7ba-95bf-4bc7-89e6-6318875c6fde","Type":"ContainerStarted","Data":"fa8b481d6eff91fb7657e65264094352eb206afc7d37c64222f8337cbec59818"} Jul 01 19:19:50.167191 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.166643 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:50.167191 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.166743 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-tls\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:50.169949 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.169893 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ae90b05-e72a-45c6-a0e6-1530decd9ba7-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-w7zhz\" (UID: \"3ae90b05-e72a-45c6-a0e6-1530decd9ba7\") " pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:50.171378 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.171353 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edc1a253-5c85-4436-98e2-6b5cbb203339-node-exporter-tls\") pod \"node-exporter-nbxvg\" (UID: \"edc1a253-5c85-4436-98e2-6b5cbb203339\") " pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:50.311588 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.311309 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nbxvg" Jul 01 19:19:50.326921 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.326888 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" Jul 01 19:19:50.358668 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:50.358630 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc1a253_5c85_4436_98e2_6b5cbb203339.slice/crio-cd2d325cc640c16e8ad92d73d19d45a63445ec3f743d291fe8ad5eec95df1a68 WatchSource:0}: Error finding container cd2d325cc640c16e8ad92d73d19d45a63445ec3f743d291fe8ad5eec95df1a68: Status 404 returned error can't find the container with id cd2d325cc640c16e8ad92d73d19d45a63445ec3f743d291fe8ad5eec95df1a68 Jul 01 19:19:50.478649 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.475053 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:19:50.514528 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.514493 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:19:50.514768 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.514604 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.517472 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.517946 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.518176 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.518327 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sf774\"" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.518358 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.518516 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:19:50.518786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.518786 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:19:50.521814 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.520887 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:19:50.521814 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.521333 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:19:50.521814 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.521545 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:19:50.563332 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.563117 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-w7zhz"] Jul 01 19:19:50.567120 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:50.566880 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae90b05_e72a_45c6_a0e6_1530decd9ba7.slice/crio-af31170c2165703fdf730ed6db1a9b71719cc074eca50bd47fe3996a92bfd3fb WatchSource:0}: Error finding container af31170c2165703fdf730ed6db1a9b71719cc074eca50bd47fe3996a92bfd3fb: Status 404 returned error can't find the container with id af31170c2165703fdf730ed6db1a9b71719cc074eca50bd47fe3996a92bfd3fb Jul 01 19:19:50.670330 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670285 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-web-config\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670330 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670340 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b225d786-9030-49cf-9397-7e15c8da8eed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670330 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670376 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b225d786-9030-49cf-9397-7e15c8da8eed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670412 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670452 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670480 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670524 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-config-volume\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670550 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670576 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b225d786-9030-49cf-9397-7e15c8da8eed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670603 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670629 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxtv2\" (UniqueName: \"kubernetes.io/projected/b225d786-9030-49cf-9397-7e15c8da8eed-kube-api-access-jxtv2\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670657 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b225d786-9030-49cf-9397-7e15c8da8eed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.670729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.670697 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b225d786-9030-49cf-9397-7e15c8da8eed-config-out\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772276 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772197 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-web-config\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772276 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772238 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b225d786-9030-49cf-9397-7e15c8da8eed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772276 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772266 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b225d786-9030-49cf-9397-7e15c8da8eed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772298 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772330 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772357 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772401 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-config-volume\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772427 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772449 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b225d786-9030-49cf-9397-7e15c8da8eed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772482 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772510 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxtv2\" (UniqueName: \"kubernetes.io/projected/b225d786-9030-49cf-9397-7e15c8da8eed-kube-api-access-jxtv2\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772904 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772539 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b225d786-9030-49cf-9397-7e15c8da8eed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.772904 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.772579 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b225d786-9030-49cf-9397-7e15c8da8eed-config-out\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.773509 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.773476 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b225d786-9030-49cf-9397-7e15c8da8eed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.774204 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.773747 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b225d786-9030-49cf-9397-7e15c8da8eed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.775169 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.774710 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b225d786-9030-49cf-9397-7e15c8da8eed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.779571 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.779501 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-web-config\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.782558 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.782534 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.784111 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.783917 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.784342 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.784296 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b225d786-9030-49cf-9397-7e15c8da8eed-config-out\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.784464 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.784438 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-config-volume\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.785976 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.785947 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.787198 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.787049 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.787668 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.787452 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b225d786-9030-49cf-9397-7e15c8da8eed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.787668 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.787637 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b225d786-9030-49cf-9397-7e15c8da8eed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.789791 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.789747 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxtv2\" (UniqueName: \"kubernetes.io/projected/b225d786-9030-49cf-9397-7e15c8da8eed-kube-api-access-jxtv2\") pod \"alertmanager-main-0\" (UID: \"b225d786-9030-49cf-9397-7e15c8da8eed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:50.832043 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.831504 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" event={"ID":"3ae90b05-e72a-45c6-a0e6-1530decd9ba7","Type":"ContainerStarted","Data":"af31170c2165703fdf730ed6db1a9b71719cc074eca50bd47fe3996a92bfd3fb"} Jul 01 19:19:50.834882 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.834793 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbxvg" event={"ID":"edc1a253-5c85-4436-98e2-6b5cbb203339","Type":"ContainerStarted","Data":"cd2d325cc640c16e8ad92d73d19d45a63445ec3f743d291fe8ad5eec95df1a68"} Jul 01 19:19:50.838594 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:50.838558 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:19:51.055694 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:51.055609 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:19:52.774393 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:52.774358 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb225d786_9030_49cf_9397_7e15c8da8eed.slice/crio-6d8b15b3d33caf591a6853c57d09075deb57c2353119e099ec05984307f859ea WatchSource:0}: Error finding container 6d8b15b3d33caf591a6853c57d09075deb57c2353119e099ec05984307f859ea: Status 404 returned error can't find the container with id 6d8b15b3d33caf591a6853c57d09075deb57c2353119e099ec05984307f859ea Jul 01 19:19:52.845233 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:52.845192 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"6d8b15b3d33caf591a6853c57d09075deb57c2353119e099ec05984307f859ea"} Jul 01 19:19:53.787180 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.785202 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-747675b68b-hbshv"] Jul 01 19:19:53.804833 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.804803 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747675b68b-hbshv"] Jul 01 19:19:53.805032 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.804926 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.810761 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.810665 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 19:19:53.810941 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.810823 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 19:19:53.810941 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.810894 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bi1sfn7b879aj\"" Jul 01 19:19:53.810941 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.810933 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 19:19:53.811241 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.811181 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r7blc\"" Jul 01 19:19:53.811428 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.811403 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:19:53.854171 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.853952 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f5w8" event={"ID":"1f63a7ba-95bf-4bc7-89e6-6318875c6fde","Type":"ContainerStarted","Data":"f2911875c6d0c3ea5c10ea09538c1c157246acf577aaeb02cf9b56274ab3b4ab"} Jul 01 19:19:53.856543 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.856514 2588 generic.go:356] "Generic (PLEG): container finished" podID="edc1a253-5c85-4436-98e2-6b5cbb203339" containerID="68f4cf7d06e0928b5909d210cf3fd2aabd41141f9e412f443a2692a83c62758b" exitCode=0 Jul 01 19:19:53.856658 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.856596 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbxvg" event={"ID":"edc1a253-5c85-4436-98e2-6b5cbb203339","Type":"ContainerDied","Data":"68f4cf7d06e0928b5909d210cf3fd2aabd41141f9e412f443a2692a83c62758b"} Jul 01 19:19:53.876256 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.875887 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8f5w8" podStartSLOduration=33.630795905 podStartE2EDuration="54.875872314s" totalImagesPullingTime="21.245076409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:53.875135168 +0000 UTC m=+90.969888250" watchObservedRunningTime="2026-07-01 19:19:53.875872314 +0000 UTC m=+90.970625375" Jul 01 19:19:53.900966 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.900934 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.901137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.900993 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cl7w\" (UniqueName: \"kubernetes.io/projected/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-kube-api-access-2cl7w\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.901137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.901020 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-metrics-server-audit-profiles\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.901137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.901049 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-secret-metrics-server-tls\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.901137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.901095 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-audit-log\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.901343 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.901189 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-secret-metrics-server-client-certs\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:53.901343 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:53.901247 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-client-ca-bundle\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.001709 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.001666 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-secret-metrics-server-client-certs\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.001915 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.001896 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-client-ca-bundle\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.001979 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.001954 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.002086 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.002043 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cl7w\" (UniqueName: \"kubernetes.io/projected/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-kube-api-access-2cl7w\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.002151 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.002093 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-metrics-server-audit-profiles\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.002151 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.002144 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-secret-metrics-server-tls\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.002244 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.002171 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-audit-log\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.004156 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.004096 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.005122 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.004955 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-audit-log\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.006828 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.006799 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-metrics-server-audit-profiles\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.007291 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.007268 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-secret-metrics-server-tls\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.007724 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.007652 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-client-ca-bundle\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.009642 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.009610 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-secret-metrics-server-client-certs\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.021520 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.021496 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cl7w\" (UniqueName: \"kubernetes.io/projected/5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0-kube-api-access-2cl7w\") pod \"metrics-server-747675b68b-hbshv\" (UID: \"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0\") " pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.123753 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.123175 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:19:54.244012 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.243980 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc77c8ccd-r8q2s"] Jul 01 19:19:54.271574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.271506 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc77c8ccd-r8q2s"] Jul 01 19:19:54.271574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.271558 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.290987 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.290962 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:19:54.406668 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406561 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-oauth-config\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.406668 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406641 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-serving-cert\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.406971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406726 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-trusted-ca-bundle\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.406971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406774 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd6sj\" (UniqueName: \"kubernetes.io/projected/0e4dba63-1de7-4bad-8668-aebbe9c974f4-kube-api-access-fd6sj\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.406971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406812 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-oauth-serving-cert\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.406971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406845 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-service-ca\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.406971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.406882 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-config\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508217 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508176 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-oauth-config\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508227 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-serving-cert\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508267 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-trusted-ca-bundle\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508295 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd6sj\" (UniqueName: \"kubernetes.io/projected/0e4dba63-1de7-4bad-8668-aebbe9c974f4-kube-api-access-fd6sj\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508326 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-oauth-serving-cert\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508354 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-service-ca\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.508438 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.508388 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-config\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.509312 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.509189 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-config\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.510448 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.510399 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-oauth-serving-cert\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.510765 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.510727 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-trusted-ca-bundle\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.511373 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.511334 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-service-ca\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.511682 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.511631 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-serving-cert\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.513245 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.513220 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-oauth-config\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.521730 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.521705 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd6sj\" (UniqueName: \"kubernetes.io/projected/0e4dba63-1de7-4bad-8668-aebbe9c974f4-kube-api-access-fd6sj\") pod \"console-bc77c8ccd-r8q2s\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:54.586958 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:54.586926 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:19:55.262626 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.262553 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747675b68b-hbshv"] Jul 01 19:19:55.267434 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:55.267396 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9d3df3_fd38_4f05_8e0e_53fd78acc7e0.slice/crio-e305963836655325c04f23816e9d85373f27bdd590c47115e885a757d00b2cba WatchSource:0}: Error finding container e305963836655325c04f23816e9d85373f27bdd590c47115e885a757d00b2cba: Status 404 returned error can't find the container with id e305963836655325c04f23816e9d85373f27bdd590c47115e885a757d00b2cba Jul 01 19:19:55.277317 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.277118 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc77c8ccd-r8q2s"] Jul 01 19:19:55.312043 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:19:55.310639 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4dba63_1de7_4bad_8668_aebbe9c974f4.slice/crio-4c8d017a9757a356b5bdbc8df0addc8b8ac733dd5c351382e8839820af764bac WatchSource:0}: Error finding container 4c8d017a9757a356b5bdbc8df0addc8b8ac733dd5c351382e8839820af764bac: Status 404 returned error can't find the container with id 4c8d017a9757a356b5bdbc8df0addc8b8ac733dd5c351382e8839820af764bac Jul 01 19:19:55.868736 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.868648 2588 generic.go:356] "Generic (PLEG): container finished" podID="b225d786-9030-49cf-9397-7e15c8da8eed" containerID="f80b2430d022d97d3e10d1ee2665f621bdc4e7df52b7f499fa784a0da81efdf4" exitCode=0 Jul 01 19:19:55.868903 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.868730 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerDied","Data":"f80b2430d022d97d3e10d1ee2665f621bdc4e7df52b7f499fa784a0da81efdf4"} Jul 01 19:19:55.871307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.871277 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbxvg" event={"ID":"edc1a253-5c85-4436-98e2-6b5cbb203339","Type":"ContainerStarted","Data":"3f1dbc7ea0dcd15a5f9eab785491bf9598db11eda6255df3ab8164bbe1532df5"} Jul 01 19:19:55.871408 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.871342 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbxvg" event={"ID":"edc1a253-5c85-4436-98e2-6b5cbb203339","Type":"ContainerStarted","Data":"8126d3d0d9c64bd2554bdae70573603d308d43ae8a8f186ac03903a250a94112"} Jul 01 19:19:55.873108 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.873080 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc77c8ccd-r8q2s" event={"ID":"0e4dba63-1de7-4bad-8668-aebbe9c974f4","Type":"ContainerStarted","Data":"36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35"} Jul 01 19:19:55.873233 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.873134 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc77c8ccd-r8q2s" event={"ID":"0e4dba63-1de7-4bad-8668-aebbe9c974f4","Type":"ContainerStarted","Data":"4c8d017a9757a356b5bdbc8df0addc8b8ac733dd5c351382e8839820af764bac"} Jul 01 19:19:55.874258 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.874237 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" event={"ID":"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0","Type":"ContainerStarted","Data":"e305963836655325c04f23816e9d85373f27bdd590c47115e885a757d00b2cba"} Jul 01 19:19:55.876697 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.876672 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" event={"ID":"3ae90b05-e72a-45c6-a0e6-1530decd9ba7","Type":"ContainerStarted","Data":"ba6960bc0861c97f6fae6ef05904d6eeab0e67245d7735e93eafb14027285e12"} Jul 01 19:19:55.876773 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.876725 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" event={"ID":"3ae90b05-e72a-45c6-a0e6-1530decd9ba7","Type":"ContainerStarted","Data":"1d0282d5e2ea73c3a68797d8313efbe92f740946b34406fb716719d1f7f0db5a"} Jul 01 19:19:55.876773 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.876760 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" event={"ID":"3ae90b05-e72a-45c6-a0e6-1530decd9ba7","Type":"ContainerStarted","Data":"1a851d0e50b310cc9da67b85e910d935ae6b63914f55968a2ba17b1394609b60"} Jul 01 19:19:55.914112 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.914046 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bc77c8ccd-r8q2s" podStartSLOduration=1.914031493 podStartE2EDuration="1.914031493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:55.912590276 +0000 UTC m=+93.007343337" watchObservedRunningTime="2026-07-01 19:19:55.914031493 +0000 UTC m=+93.008784556" Jul 01 19:19:55.935876 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.935815 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nbxvg" podStartSLOduration=3.9924123270000003 podStartE2EDuration="6.935796564s" totalImagesPullingTime="2.833987704s" totalInitContainerRuntime="109.396533ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:55.934196172 +0000 UTC m=+93.028949259" watchObservedRunningTime="2026-07-01 19:19:55.935796564 +0000 UTC m=+93.030549627" Jul 01 19:19:55.957366 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:55.957301 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-w7zhz" podStartSLOduration=2.4476373049999998 podStartE2EDuration="6.957281327s" totalImagesPullingTime="4.509644022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:55.955463519 +0000 UTC m=+93.050216618" watchObservedRunningTime="2026-07-01 19:19:55.957281327 +0000 UTC m=+93.052034389" Jul 01 19:19:57.887968 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:57.887924 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" event={"ID":"5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0","Type":"ContainerStarted","Data":"3af253349ba964a8998c2d91665134e45dd56ec40f1e6fb682e1fa7c4efb3854"} Jul 01 19:19:57.906203 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:57.906151 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" podStartSLOduration=2.67453604 podStartE2EDuration="4.906134764s" totalImagesPullingTime="2.231598724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:57.903973349 +0000 UTC m=+94.998726419" watchObservedRunningTime="2026-07-01 19:19:57.906134764 +0000 UTC m=+95.000887876" Jul 01 19:19:59.898679 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:59.898654 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"65f874e74340a4465f1e21fb1bc14292c50f1aae6460a87717d04ad05524c4b9"} Jul 01 19:19:59.898956 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:19:59.898716 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"8e20c9798189026b26be66270922626a8bb3b18ba3b9e11bcac45eb48b487a87"} Jul 01 19:20:00.905990 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:00.905958 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"72ddee297900a6d653a4c8b6a7e47eb6ed60611cdd44438bf4551d668667f4d5"} Jul 01 19:20:00.906426 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:00.906019 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"278d29cce94df6322a0fda61285caf9b2da6d4b995c1d75a1e72ac792e13f23c"} Jul 01 19:20:00.906426 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:00.906045 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"8b83572ffffdbb96ab34182ef160c9129c558921409475fa10a91f2fbec5c030"} Jul 01 19:20:01.913119 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:01.913085 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b225d786-9030-49cf-9397-7e15c8da8eed","Type":"ContainerStarted","Data":"7c994075c9352d5cdb46a02458335ab3c1a9abf52235c63a4f0e80581fd368c2"} Jul 01 19:20:01.945390 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:01.945329 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.037767376 podStartE2EDuration="11.945313632s" totalImagesPullingTime="6.887272645s" totalInitContainerRuntime="20.273611ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:01.944136747 +0000 UTC m=+99.038889833" watchObservedRunningTime="2026-07-01 19:20:01.945313632 +0000 UTC m=+99.040066693" Jul 01 19:20:04.587976 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:04.587933 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:20:04.588487 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:04.588049 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:20:04.593952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:04.593923 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:20:04.930112 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:04.930084 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:20:06.564809 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.564772 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bc556858-f2jnj" podUID="eefcab7b-f2f1-4660-8607-411fc69ab11e" containerName="console" containerID="cri-o://30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00" gracePeriod=15 Jul 01 19:20:06.834158 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.834096 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:20:06.919602 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.919568 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-service-ca\") pod \"eefcab7b-f2f1-4660-8607-411fc69ab11e\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " Jul 01 19:20:06.919777 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.919615 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-config\") pod \"eefcab7b-f2f1-4660-8607-411fc69ab11e\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " Jul 01 19:20:06.919777 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.919654 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-oauth-config\") pod \"eefcab7b-f2f1-4660-8607-411fc69ab11e\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " Jul 01 19:20:06.919777 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.919677 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvb7f\" (UniqueName: \"kubernetes.io/projected/eefcab7b-f2f1-4660-8607-411fc69ab11e-kube-api-access-qvb7f\") pod \"eefcab7b-f2f1-4660-8607-411fc69ab11e\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " Jul 01 19:20:06.919777 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.919720 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-serving-cert\") pod \"eefcab7b-f2f1-4660-8607-411fc69ab11e\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " Jul 01 19:20:06.919777 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.919748 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-oauth-serving-cert\") pod \"eefcab7b-f2f1-4660-8607-411fc69ab11e\" (UID: \"eefcab7b-f2f1-4660-8607-411fc69ab11e\") " Jul 01 19:20:06.920146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.920114 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-service-ca" (OuterVolumeSpecName: "service-ca") pod "eefcab7b-f2f1-4660-8607-411fc69ab11e" (UID: "eefcab7b-f2f1-4660-8607-411fc69ab11e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:06.920236 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.920166 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-config" (OuterVolumeSpecName: "console-config") pod "eefcab7b-f2f1-4660-8607-411fc69ab11e" (UID: "eefcab7b-f2f1-4660-8607-411fc69ab11e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:06.920236 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.920206 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eefcab7b-f2f1-4660-8607-411fc69ab11e" (UID: "eefcab7b-f2f1-4660-8607-411fc69ab11e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:20:06.922041 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.922007 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eefcab7b-f2f1-4660-8607-411fc69ab11e" (UID: "eefcab7b-f2f1-4660-8607-411fc69ab11e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:20:06.922207 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.922104 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eefcab7b-f2f1-4660-8607-411fc69ab11e" (UID: "eefcab7b-f2f1-4660-8607-411fc69ab11e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:20:06.922251 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.922218 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefcab7b-f2f1-4660-8607-411fc69ab11e-kube-api-access-qvb7f" (OuterVolumeSpecName: "kube-api-access-qvb7f") pod "eefcab7b-f2f1-4660-8607-411fc69ab11e" (UID: "eefcab7b-f2f1-4660-8607-411fc69ab11e"). InnerVolumeSpecName "kube-api-access-qvb7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:20:06.935392 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.935368 2588 generic.go:356] "Generic (PLEG): container finished" podID="eefcab7b-f2f1-4660-8607-411fc69ab11e" containerID="30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00" exitCode=0 Jul 01 19:20:06.935492 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.935418 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc556858-f2jnj" Jul 01 19:20:06.935492 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.935452 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc556858-f2jnj" event={"ID":"eefcab7b-f2f1-4660-8607-411fc69ab11e","Type":"ContainerDied","Data":"30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00"} Jul 01 19:20:06.935564 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.935504 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc556858-f2jnj" event={"ID":"eefcab7b-f2f1-4660-8607-411fc69ab11e","Type":"ContainerDied","Data":"5801af87fe29184305063ad4a545cec9da895f6a443e7f7c43ba1b4cbd20a1b9"} Jul 01 19:20:06.935564 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.935532 2588 scope.go:117] "RemoveContainer" containerID="30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00" Jul 01 19:20:06.943573 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.943550 2588 scope.go:117] "RemoveContainer" containerID="30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00" Jul 01 19:20:06.943831 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:20:06.943811 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00\": container with ID starting with 30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00 not found: ID does not exist" containerID="30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00" Jul 01 19:20:06.943882 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.943840 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00"} err="failed to get container status \"30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00\": rpc error: code = NotFound desc = could not find container \"30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00\": container with ID starting with 30f299cdf18ac8e0c144550547aa777265d62eb5101c899667bbdc68b95add00 not found: ID does not exist" Jul 01 19:20:06.956128 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.956081 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc556858-f2jnj"] Jul 01 19:20:06.957822 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:06.957803 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc556858-f2jnj"] Jul 01 19:20:07.020797 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.020771 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.020797 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.020795 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvb7f\" (UniqueName: \"kubernetes.io/projected/eefcab7b-f2f1-4660-8607-411fc69ab11e-kube-api-access-qvb7f\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.020947 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.020807 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.020947 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.020815 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.020947 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.020824 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.020947 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.020833 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefcab7b-f2f1-4660-8607-411fc69ab11e-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:20:07.330771 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.330738 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eefcab7b-f2f1-4660-8607-411fc69ab11e" path="/var/lib/kubelet/pods/eefcab7b-f2f1-4660-8607-411fc69ab11e/volumes" Jul 01 19:20:07.766313 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:07.766289 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l826r" Jul 01 19:20:09.728671 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:09.728642 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jcw8n_cf31ca3d-1613-498b-914f-5d3c9fb3c61f/serve-healthcheck-canary/0.log" Jul 01 19:20:14.123846 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:14.123807 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:20:14.124311 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:14.123878 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:20:34.129753 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:34.129724 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:20:34.133534 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:20:34.133511 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-747675b68b-hbshv" Jul 01 19:21:13.778409 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.778370 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67cb8d448f-x99sf"] Jul 01 19:21:13.779630 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.779605 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefcab7b-f2f1-4660-8607-411fc69ab11e" containerName="console" Jul 01 19:21:13.779780 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.779769 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefcab7b-f2f1-4660-8607-411fc69ab11e" containerName="console" Jul 01 19:21:13.780010 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.779998 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefcab7b-f2f1-4660-8607-411fc69ab11e" containerName="console" Jul 01 19:21:13.785653 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.785630 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.790451 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.790259 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 19:21:13.790451 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.790254 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 19:21:13.790451 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.790325 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5p9l2\"" Jul 01 19:21:13.790451 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.790336 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 19:21:13.790451 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.790448 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 19:21:13.790779 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.790449 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 19:21:13.795762 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.795738 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 19:21:13.795890 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.795870 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67cb8d448f-x99sf"] Jul 01 19:21:13.852999 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.852959 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-secret-telemeter-client\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.852999 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.852992 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbk9\" (UniqueName: \"kubernetes.io/projected/9ca846ce-0d3d-4366-8c27-39364db51fa6-kube-api-access-4dbk9\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.853286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.853030 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-federate-client-tls\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.853286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.853143 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-telemeter-client-tls\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.853286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.853190 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-serving-certs-ca-bundle\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.853286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.853256 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.853286 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.853284 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-metrics-client-ca\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.853486 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.853321 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.953919 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.953884 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-federate-client-tls\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.953931 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-telemeter-client-tls\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.953965 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-serving-certs-ca-bundle\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954004 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954034 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-metrics-client-ca\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954146 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954091 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954408 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954203 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-secret-telemeter-client\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954408 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954262 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbk9\" (UniqueName: \"kubernetes.io/projected/9ca846ce-0d3d-4366-8c27-39364db51fa6-kube-api-access-4dbk9\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.954891 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954868 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-serving-certs-ca-bundle\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.955009 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.954904 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-metrics-client-ca\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.955480 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.955458 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca846ce-0d3d-4366-8c27-39364db51fa6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.956576 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.956554 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.956805 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.956780 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-federate-client-tls\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.956873 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.956859 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-telemeter-client-tls\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.956958 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.956941 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9ca846ce-0d3d-4366-8c27-39364db51fa6-secret-telemeter-client\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:13.964141 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:13.964122 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbk9\" (UniqueName: \"kubernetes.io/projected/9ca846ce-0d3d-4366-8c27-39364db51fa6-kube-api-access-4dbk9\") pod \"telemeter-client-67cb8d448f-x99sf\" (UID: \"9ca846ce-0d3d-4366-8c27-39364db51fa6\") " pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:14.097289 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:14.097202 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" Jul 01 19:21:14.237174 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:14.237150 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67cb8d448f-x99sf"] Jul 01 19:21:14.238622 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:21:14.238592 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca846ce_0d3d_4366_8c27_39364db51fa6.slice/crio-464596caabc875bce91d98a841d46880a6afa5942d071407225be48851ca9ca7 WatchSource:0}: Error finding container 464596caabc875bce91d98a841d46880a6afa5942d071407225be48851ca9ca7: Status 404 returned error can't find the container with id 464596caabc875bce91d98a841d46880a6afa5942d071407225be48851ca9ca7 Jul 01 19:21:15.197633 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:15.197596 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" event={"ID":"9ca846ce-0d3d-4366-8c27-39364db51fa6","Type":"ContainerStarted","Data":"464596caabc875bce91d98a841d46880a6afa5942d071407225be48851ca9ca7"} Jul 01 19:21:17.208217 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:17.208186 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" event={"ID":"9ca846ce-0d3d-4366-8c27-39364db51fa6","Type":"ContainerStarted","Data":"429eb4a4be613585016c06c2fe6e6d365b031cf27a2751916493722ecbe9ad1f"} Jul 01 19:21:17.208584 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:17.208243 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" event={"ID":"9ca846ce-0d3d-4366-8c27-39364db51fa6","Type":"ContainerStarted","Data":"6ae55a1a8665e7328e541dc42ab186e767c9d9052f919271fe06a475a1e8a863"} Jul 01 19:21:17.208584 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:17.208262 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" event={"ID":"9ca846ce-0d3d-4366-8c27-39364db51fa6","Type":"ContainerStarted","Data":"7b77cb7bd797c67e2a5599a415332dfb8d5cafde73e48bab39014ef4a6c440d1"} Jul 01 19:21:17.233718 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:17.233655 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67cb8d448f-x99sf" podStartSLOduration=1.892453304 podStartE2EDuration="4.233636137s" totalImagesPullingTime="2.341182833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:17.232365671 +0000 UTC m=+174.327118744" watchObservedRunningTime="2026-07-01 19:21:17.233636137 +0000 UTC m=+174.328389220" Jul 01 19:21:18.197473 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.197431 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677f44cff9-8tsn9"] Jul 01 19:21:18.201210 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.201184 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.211856 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.211829 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677f44cff9-8tsn9"] Jul 01 19:21:18.296545 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.296504 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-trusted-ca-bundle\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.296734 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.296666 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-config\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.296857 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.296826 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-oauth-config\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.297000 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.296985 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-serving-cert\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.297107 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.297090 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-oauth-serving-cert\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.297162 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.297125 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmzkj\" (UniqueName: \"kubernetes.io/projected/c0eba7c6-d266-4cb2-b80d-3df438d19b42-kube-api-access-gmzkj\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.297223 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.297181 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-service-ca\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398238 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398197 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-trusted-ca-bundle\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398238 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398241 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-config\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398598 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398570 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-oauth-config\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398688 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398667 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-serving-cert\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398740 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398728 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-oauth-serving-cert\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398790 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398760 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmzkj\" (UniqueName: \"kubernetes.io/projected/c0eba7c6-d266-4cb2-b80d-3df438d19b42-kube-api-access-gmzkj\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.398847 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.398835 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-service-ca\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.399263 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.399008 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-config\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.399263 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.399210 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-trusted-ca-bundle\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.399697 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.399679 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-oauth-serving-cert\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.399736 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.399702 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-service-ca\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.401219 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.401189 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-oauth-config\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.401315 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.401285 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-serving-cert\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.406896 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.406874 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmzkj\" (UniqueName: \"kubernetes.io/projected/c0eba7c6-d266-4cb2-b80d-3df438d19b42-kube-api-access-gmzkj\") pod \"console-677f44cff9-8tsn9\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.513290 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.513201 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:18.646414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:18.646383 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677f44cff9-8tsn9"] Jul 01 19:21:18.649321 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:21:18.649296 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0eba7c6_d266_4cb2_b80d_3df438d19b42.slice/crio-b1312a08579982fa0627ff1e9e5c2535d8ca7f1836955c864921e3a47ea918b3 WatchSource:0}: Error finding container b1312a08579982fa0627ff1e9e5c2535d8ca7f1836955c864921e3a47ea918b3: Status 404 returned error can't find the container with id b1312a08579982fa0627ff1e9e5c2535d8ca7f1836955c864921e3a47ea918b3 Jul 01 19:21:19.218871 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:19.218836 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f44cff9-8tsn9" event={"ID":"c0eba7c6-d266-4cb2-b80d-3df438d19b42","Type":"ContainerStarted","Data":"b7497b61b4f93b2ff303d4bb94e19bd25eb7c62db14b45f8927718278d1a3f14"} Jul 01 19:21:19.219468 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:19.218899 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f44cff9-8tsn9" event={"ID":"c0eba7c6-d266-4cb2-b80d-3df438d19b42","Type":"ContainerStarted","Data":"b1312a08579982fa0627ff1e9e5c2535d8ca7f1836955c864921e3a47ea918b3"} Jul 01 19:21:19.239022 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:19.238960 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677f44cff9-8tsn9" podStartSLOduration=1.238937259 podStartE2EDuration="1.238937259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:19.237231987 +0000 UTC m=+176.331985081" watchObservedRunningTime="2026-07-01 19:21:19.238937259 +0000 UTC m=+176.333690321" Jul 01 19:21:26.100486 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.100440 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677f44cff9-8tsn9"] Jul 01 19:21:26.139269 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.139244 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d8d85dbc-q2b99"] Jul 01 19:21:26.145724 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.145703 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.153257 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.153235 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d8d85dbc-q2b99"] Jul 01 19:21:26.265030 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265001 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-serving-cert\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.265195 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265043 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-oauth-config\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.265195 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265087 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-service-ca\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.265195 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265130 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-config\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.265195 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265181 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-trusted-ca-bundle\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.265324 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265203 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jhdg\" (UniqueName: \"kubernetes.io/projected/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-kube-api-access-7jhdg\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.265324 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.265269 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-oauth-serving-cert\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366348 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366266 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-config\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366348 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366304 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-trusted-ca-bundle\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366348 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366323 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jhdg\" (UniqueName: \"kubernetes.io/projected/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-kube-api-access-7jhdg\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366348 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366347 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-oauth-serving-cert\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366654 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366396 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-serving-cert\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366654 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366416 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-oauth-config\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.366654 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.366431 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-service-ca\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.367219 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.367194 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-config\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.367304 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.367250 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-service-ca\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.367304 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.367256 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-oauth-serving-cert\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.367304 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.367267 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-trusted-ca-bundle\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.369439 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.369410 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-oauth-config\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.369582 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.369559 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-console-serving-cert\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.376070 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.376034 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jhdg\" (UniqueName: \"kubernetes.io/projected/901ab6a1-3765-4c03-bf19-4a1c2580ffb6-kube-api-access-7jhdg\") pod \"console-57d8d85dbc-q2b99\" (UID: \"901ab6a1-3765-4c03-bf19-4a1c2580ffb6\") " pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.455180 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.455140 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:26.594709 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:26.594684 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d8d85dbc-q2b99"] Jul 01 19:21:26.596232 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:21:26.596203 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901ab6a1_3765_4c03_bf19_4a1c2580ffb6.slice/crio-de1d8333fed5233ff66bfbcc6440550f9aa4ff3d199f92300136967117d97cd9 WatchSource:0}: Error finding container de1d8333fed5233ff66bfbcc6440550f9aa4ff3d199f92300136967117d97cd9: Status 404 returned error can't find the container with id de1d8333fed5233ff66bfbcc6440550f9aa4ff3d199f92300136967117d97cd9 Jul 01 19:21:27.253531 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:27.253501 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d8d85dbc-q2b99" event={"ID":"901ab6a1-3765-4c03-bf19-4a1c2580ffb6","Type":"ContainerStarted","Data":"77cdb7c8a073f880c3526a9d4b56a164ab1342ba26e3ac1753688afab4075a29"} Jul 01 19:21:27.253885 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:27.253547 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d8d85dbc-q2b99" event={"ID":"901ab6a1-3765-4c03-bf19-4a1c2580ffb6","Type":"ContainerStarted","Data":"de1d8333fed5233ff66bfbcc6440550f9aa4ff3d199f92300136967117d97cd9"} Jul 01 19:21:27.274310 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:27.274262 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57d8d85dbc-q2b99" podStartSLOduration=1.2742458540000001 podStartE2EDuration="1.274245854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:27.273509054 +0000 UTC m=+184.368262136" watchObservedRunningTime="2026-07-01 19:21:27.274245854 +0000 UTC m=+184.368998916" Jul 01 19:21:28.514223 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:28.514184 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:36.455226 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:36.455195 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:36.455719 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:36.455258 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:36.460073 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:36.460038 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:37.296718 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:37.296690 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57d8d85dbc-q2b99" Jul 01 19:21:37.356769 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:37.356733 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc77c8ccd-r8q2s"] Jul 01 19:21:51.120361 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.120318 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-677f44cff9-8tsn9" podUID="c0eba7c6-d266-4cb2-b80d-3df438d19b42" containerName="console" containerID="cri-o://b7497b61b4f93b2ff303d4bb94e19bd25eb7c62db14b45f8927718278d1a3f14" gracePeriod=15 Jul 01 19:21:51.351747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.351719 2588 generic.go:356] "Generic (PLEG): container finished" podID="c0eba7c6-d266-4cb2-b80d-3df438d19b42" containerID="b7497b61b4f93b2ff303d4bb94e19bd25eb7c62db14b45f8927718278d1a3f14" exitCode=0 Jul 01 19:21:51.351875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.351775 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f44cff9-8tsn9" event={"ID":"c0eba7c6-d266-4cb2-b80d-3df438d19b42","Type":"ContainerDied","Data":"b7497b61b4f93b2ff303d4bb94e19bd25eb7c62db14b45f8927718278d1a3f14"} Jul 01 19:21:51.365714 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.365693 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:51.386784 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386758 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-oauth-serving-cert\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.386939 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386808 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-oauth-config\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.386939 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386830 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmzkj\" (UniqueName: \"kubernetes.io/projected/c0eba7c6-d266-4cb2-b80d-3df438d19b42-kube-api-access-gmzkj\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.386939 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386863 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-config\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.386939 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386883 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-service-ca\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.386939 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386911 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-trusted-ca-bundle\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.387235 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.386943 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-serving-cert\") pod \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\" (UID: \"c0eba7c6-d266-4cb2-b80d-3df438d19b42\") " Jul 01 19:21:51.387289 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.387232 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:21:51.387395 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.387344 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:21:51.388039 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.388007 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-config" (OuterVolumeSpecName: "console-config") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:21:51.388202 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.388158 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:21:51.389364 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.389339 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:21:51.389655 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.389633 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0eba7c6-d266-4cb2-b80d-3df438d19b42-kube-api-access-gmzkj" (OuterVolumeSpecName: "kube-api-access-gmzkj") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "kube-api-access-gmzkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:21:51.389744 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.389688 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0eba7c6-d266-4cb2-b80d-3df438d19b42" (UID: "c0eba7c6-d266-4cb2-b80d-3df438d19b42"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:21:51.488219 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488186 2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-trusted-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:51.488219 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488213 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:51.488219 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488222 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:51.488442 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488230 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:51.488442 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488238 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmzkj\" (UniqueName: \"kubernetes.io/projected/c0eba7c6-d266-4cb2-b80d-3df438d19b42-kube-api-access-gmzkj\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:51.488442 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488246 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:51.488442 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:51.488254 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0eba7c6-d266-4cb2-b80d-3df438d19b42-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:21:52.357103 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:52.357071 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f44cff9-8tsn9" Jul 01 19:21:52.357103 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:52.357081 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f44cff9-8tsn9" event={"ID":"c0eba7c6-d266-4cb2-b80d-3df438d19b42","Type":"ContainerDied","Data":"b1312a08579982fa0627ff1e9e5c2535d8ca7f1836955c864921e3a47ea918b3"} Jul 01 19:21:52.357550 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:52.357146 2588 scope.go:117] "RemoveContainer" containerID="b7497b61b4f93b2ff303d4bb94e19bd25eb7c62db14b45f8927718278d1a3f14" Jul 01 19:21:52.382628 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:52.382585 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677f44cff9-8tsn9"] Jul 01 19:21:52.394019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:52.393989 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677f44cff9-8tsn9"] Jul 01 19:21:53.331979 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:21:53.331942 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0eba7c6-d266-4cb2-b80d-3df438d19b42" path="/var/lib/kubelet/pods/c0eba7c6-d266-4cb2-b80d-3df438d19b42/volumes" Jul 01 19:22:02.384228 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.384164 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bc77c8ccd-r8q2s" podUID="0e4dba63-1de7-4bad-8668-aebbe9c974f4" containerName="console" containerID="cri-o://36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35" gracePeriod=15 Jul 01 19:22:02.629347 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.629325 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:22:02.686105 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686008 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-trusted-ca-bundle\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686105 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686053 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-serving-cert\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686391 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686115 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd6sj\" (UniqueName: \"kubernetes.io/projected/0e4dba63-1de7-4bad-8668-aebbe9c974f4-kube-api-access-fd6sj\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686391 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686133 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-service-ca\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686391 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686160 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-config\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686391 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686191 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-oauth-config\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686391 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686215 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-oauth-serving-cert\") pod \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\" (UID: \"0e4dba63-1de7-4bad-8668-aebbe9c974f4\") " Jul 01 19:22:02.686629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686559 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:22:02.686629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686580 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:22:02.686629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686584 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-config" (OuterVolumeSpecName: "console-config") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:22:02.686722 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.686668 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:22:02.688322 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.688293 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:22:02.688417 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.688387 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4dba63-1de7-4bad-8668-aebbe9c974f4-kube-api-access-fd6sj" (OuterVolumeSpecName: "kube-api-access-fd6sj") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "kube-api-access-fd6sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:22:02.688417 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.688399 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e4dba63-1de7-4bad-8668-aebbe9c974f4" (UID: "0e4dba63-1de7-4bad-8668-aebbe9c974f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:22:02.787414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787363 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd6sj\" (UniqueName: \"kubernetes.io/projected/0e4dba63-1de7-4bad-8668-aebbe9c974f4-kube-api-access-fd6sj\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:02.787414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787406 2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:02.787414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787417 2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:02.787414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787425 2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:02.787414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787433 2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:02.787718 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787441 2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4dba63-1de7-4bad-8668-aebbe9c974f4-trusted-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:02.787718 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:02.787449 2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e4dba63-1de7-4bad-8668-aebbe9c974f4-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:22:03.400295 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.400257 2588 generic.go:356] "Generic (PLEG): container finished" podID="0e4dba63-1de7-4bad-8668-aebbe9c974f4" containerID="36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35" exitCode=0 Jul 01 19:22:03.400747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.400306 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc77c8ccd-r8q2s" Jul 01 19:22:03.400747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.400351 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc77c8ccd-r8q2s" event={"ID":"0e4dba63-1de7-4bad-8668-aebbe9c974f4","Type":"ContainerDied","Data":"36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35"} Jul 01 19:22:03.400747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.400417 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc77c8ccd-r8q2s" event={"ID":"0e4dba63-1de7-4bad-8668-aebbe9c974f4","Type":"ContainerDied","Data":"4c8d017a9757a356b5bdbc8df0addc8b8ac733dd5c351382e8839820af764bac"} Jul 01 19:22:03.400747 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.400450 2588 scope.go:117] "RemoveContainer" containerID="36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35" Jul 01 19:22:03.408255 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.408238 2588 scope.go:117] "RemoveContainer" containerID="36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35" Jul 01 19:22:03.408496 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:22:03.408477 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35\": container with ID starting with 36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35 not found: ID does not exist" containerID="36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35" Jul 01 19:22:03.408551 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.408503 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35"} err="failed to get container status \"36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35\": rpc error: code = NotFound desc = could not find container \"36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35\": container with ID starting with 36d22ce14b85c87f057fc068107c72aea324b6662ef03e87aa2414cfa113cd35 not found: ID does not exist" Jul 01 19:22:03.421069 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.421034 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc77c8ccd-r8q2s"] Jul 01 19:22:03.425431 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:03.425412 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc77c8ccd-r8q2s"] Jul 01 19:22:05.332203 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:05.332166 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4dba63-1de7-4bad-8668-aebbe9c974f4" path="/var/lib/kubelet/pods/0e4dba63-1de7-4bad-8668-aebbe9c974f4/volumes" Jul 01 19:22:55.648570 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648494 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc"] Jul 01 19:22:55.649019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648798 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4dba63-1de7-4bad-8668-aebbe9c974f4" containerName="console" Jul 01 19:22:55.649019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648809 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4dba63-1de7-4bad-8668-aebbe9c974f4" containerName="console" Jul 01 19:22:55.649019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648825 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0eba7c6-d266-4cb2-b80d-3df438d19b42" containerName="console" Jul 01 19:22:55.649019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648830 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0eba7c6-d266-4cb2-b80d-3df438d19b42" containerName="console" Jul 01 19:22:55.649019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648879 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4dba63-1de7-4bad-8668-aebbe9c974f4" containerName="console" Jul 01 19:22:55.649019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.648890 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0eba7c6-d266-4cb2-b80d-3df438d19b42" containerName="console" Jul 01 19:22:55.651754 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.651737 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.654777 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.654755 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 19:22:55.655405 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.655381 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 19:22:55.656034 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.656013 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5bhzk\"" Jul 01 19:22:55.669571 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.669538 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc"] Jul 01 19:22:55.733528 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.733481 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z586g\" (UniqueName: \"kubernetes.io/projected/34718e8c-e61c-4373-b0ac-6cfbd803046c-kube-api-access-z586g\") pod \"cert-manager-webhook-7dc76cbb94-k8ggc\" (UID: \"34718e8c-e61c-4373-b0ac-6cfbd803046c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.733720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.733611 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34718e8c-e61c-4373-b0ac-6cfbd803046c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k8ggc\" (UID: \"34718e8c-e61c-4373-b0ac-6cfbd803046c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.834494 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.834446 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z586g\" (UniqueName: \"kubernetes.io/projected/34718e8c-e61c-4373-b0ac-6cfbd803046c-kube-api-access-z586g\") pod \"cert-manager-webhook-7dc76cbb94-k8ggc\" (UID: \"34718e8c-e61c-4373-b0ac-6cfbd803046c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.834650 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.834552 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34718e8c-e61c-4373-b0ac-6cfbd803046c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k8ggc\" (UID: \"34718e8c-e61c-4373-b0ac-6cfbd803046c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.854608 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.854576 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34718e8c-e61c-4373-b0ac-6cfbd803046c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k8ggc\" (UID: \"34718e8c-e61c-4373-b0ac-6cfbd803046c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.854762 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.854716 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z586g\" (UniqueName: \"kubernetes.io/projected/34718e8c-e61c-4373-b0ac-6cfbd803046c-kube-api-access-z586g\") pod \"cert-manager-webhook-7dc76cbb94-k8ggc\" (UID: \"34718e8c-e61c-4373-b0ac-6cfbd803046c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:55.960917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:55.960829 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:56.115962 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:56.115933 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc"] Jul 01 19:22:56.118898 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:22:56.118869 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34718e8c_e61c_4373_b0ac_6cfbd803046c.slice/crio-e73f87bb5a4ac6010b418040ce350999402864309fff058503bd22191033af36 WatchSource:0}: Error finding container e73f87bb5a4ac6010b418040ce350999402864309fff058503bd22191033af36: Status 404 returned error can't find the container with id e73f87bb5a4ac6010b418040ce350999402864309fff058503bd22191033af36 Jul 01 19:22:56.607410 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:56.607373 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" event={"ID":"34718e8c-e61c-4373-b0ac-6cfbd803046c","Type":"ContainerStarted","Data":"e73f87bb5a4ac6010b418040ce350999402864309fff058503bd22191033af36"} Jul 01 19:22:59.621818 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:59.621786 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" event={"ID":"34718e8c-e61c-4373-b0ac-6cfbd803046c","Type":"ContainerStarted","Data":"faab74568d09f8786c74db72ef5747ca6a92b419d6a3a019c94cc35103a63675"} Jul 01 19:22:59.622231 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:59.621846 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:22:59.646718 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:22:59.646672 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" podStartSLOduration=1.7218983319999999 podStartE2EDuration="4.646655146s" totalImagesPullingTime="2.924756814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:59.646248392 +0000 UTC m=+276.741001449" watchObservedRunningTime="2026-07-01 19:22:59.646655146 +0000 UTC m=+276.741408206" Jul 01 19:23:05.628715 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:05.628686 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k8ggc" Jul 01 19:23:23.263306 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:23.263278 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:23:23.266593 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:23.266572 2588 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:23:23.277903 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:23.277883 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:23:30.132865 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.132829 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl"] Jul 01 19:23:30.141124 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.141107 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.145926 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.145902 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 19:23:30.148114 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.148097 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cbmqr\"" Jul 01 19:23:30.148234 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.148212 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 19:23:30.148296 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.148237 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 19:23:30.149494 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.149480 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 19:23:30.179616 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.179587 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl"] Jul 01 19:23:30.232450 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.232416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.232620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.232467 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.232620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.232494 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.232620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.232555 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.232620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.232607 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjrdf\" (UniqueName: \"kubernetes.io/projected/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-kube-api-access-sjrdf\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.333571 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.333537 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.333738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.333584 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.333738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.333600 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.333738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.333617 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.333738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.333651 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjrdf\" (UniqueName: \"kubernetes.io/projected/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-kube-api-access-sjrdf\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.334008 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.333983 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.335894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.335875 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.336147 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.336128 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.336216 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.336169 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.342507 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.342483 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjrdf\" (UniqueName: \"kubernetes.io/projected/0dd4dce1-d70c-4317-ae6a-581b90ab7ce3-kube-api-access-sjrdf\") pod \"opendatahub-operator-controller-manager-7744974bcd-987rl\" (UID: \"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.451396 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.451312 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:30.601409 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.601384 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl"] Jul 01 19:23:30.603312 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:23:30.603277 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd4dce1_d70c_4317_ae6a_581b90ab7ce3.slice/crio-9500e174b24d16d5ccd57f5bb3c915ca879a6cc626d615a6357eb82a7726cdd2 WatchSource:0}: Error finding container 9500e174b24d16d5ccd57f5bb3c915ca879a6cc626d615a6357eb82a7726cdd2: Status 404 returned error can't find the container with id 9500e174b24d16d5ccd57f5bb3c915ca879a6cc626d615a6357eb82a7726cdd2 Jul 01 19:23:30.605086 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.605052 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:23:30.741045 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:30.740958 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" event={"ID":"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3","Type":"ContainerStarted","Data":"9500e174b24d16d5ccd57f5bb3c915ca879a6cc626d615a6357eb82a7726cdd2"} Jul 01 19:23:33.759388 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:33.759315 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" event={"ID":"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3","Type":"ContainerStarted","Data":"a03784abc97a4846bbb2b0c7673ff8e9ba0be573e5b4ad43e54c08ba7c67b1ad"} Jul 01 19:23:34.765604 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:34.765565 2588 generic.go:356] "Generic (PLEG): container finished" podID="0dd4dce1-d70c-4317-ae6a-581b90ab7ce3" containerID="a03784abc97a4846bbb2b0c7673ff8e9ba0be573e5b4ad43e54c08ba7c67b1ad" exitCode=0 Jul 01 19:23:34.765971 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:34.765627 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" event={"ID":"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3","Type":"ContainerDied","Data":"a03784abc97a4846bbb2b0c7673ff8e9ba0be573e5b4ad43e54c08ba7c67b1ad"} Jul 01 19:23:35.771053 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:35.771021 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" event={"ID":"0dd4dce1-d70c-4317-ae6a-581b90ab7ce3","Type":"ContainerStarted","Data":"3b46e8f2720aaf6edaf425be9ecf7cf043ea26b473b5a6edde11944773346cbc"} Jul 01 19:23:35.771429 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:35.771122 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:35.796921 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:35.796870 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" podStartSLOduration=1.452413231 podStartE2EDuration="5.796854211s" totalImagesPullingTime="3.337940426s" totalInitContainerRuntime="1.006500554s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:35.794363241 +0000 UTC m=+312.889116302" watchObservedRunningTime="2026-07-01 19:23:35.796854211 +0000 UTC m=+312.891607271" Jul 01 19:23:46.777072 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:46.777036 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-987rl" Jul 01 19:23:49.182533 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.182495 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx"] Jul 01 19:23:49.185965 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.185946 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.201318 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.201292 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 19:23:49.201318 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.201294 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 19:23:49.201513 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.201365 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xhg5g\"" Jul 01 19:23:49.201513 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.201393 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:23:49.201880 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.201867 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:23:49.225502 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.225478 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx"] Jul 01 19:23:49.292713 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.292672 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.292917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.292748 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tmp\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.292917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.292833 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljh7\" (UniqueName: \"kubernetes.io/projected/2f319e5b-20f6-426e-a24e-f7dba94d4c25-kube-api-access-qljh7\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.394393 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.394347 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljh7\" (UniqueName: \"kubernetes.io/projected/2f319e5b-20f6-426e-a24e-f7dba94d4c25-kube-api-access-qljh7\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.394588 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.394430 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.394588 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.394488 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tmp\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.394789 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:23:49.394634 2588 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 01 19:23:49.394789 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:23:49.394714 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tls-certs podName:2f319e5b-20f6-426e-a24e-f7dba94d4c25 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:49.894695061 +0000 UTC m=+326.989448104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tls-certs") pod "kube-auth-proxy-7994ff9b78-bfzbx" (UID: "2f319e5b-20f6-426e-a24e-f7dba94d4c25") : secret "kube-auth-proxy-tls" not found Jul 01 19:23:49.397337 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.397310 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tmp\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.440158 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.440072 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljh7\" (UniqueName: \"kubernetes.io/projected/2f319e5b-20f6-426e-a24e-f7dba94d4c25-kube-api-access-qljh7\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.518275 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.518235 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-l9l8p"] Jul 01 19:23:49.521809 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.521786 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:49.525432 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.525410 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 19:23:49.525753 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.525739 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rlgnz\"" Jul 01 19:23:49.544281 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.544252 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-l9l8p"] Jul 01 19:23:49.597225 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.597195 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktbqj\" (UniqueName: \"kubernetes.io/projected/679bb779-7d18-45d8-adda-79e16c1bcea7-kube-api-access-ktbqj\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:49.597411 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.597248 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/679bb779-7d18-45d8-adda-79e16c1bcea7-cert\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:49.698423 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.698330 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktbqj\" (UniqueName: \"kubernetes.io/projected/679bb779-7d18-45d8-adda-79e16c1bcea7-kube-api-access-ktbqj\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:49.698423 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.698388 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/679bb779-7d18-45d8-adda-79e16c1bcea7-cert\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:49.698647 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:23:49.698525 2588 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 19:23:49.698647 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:23:49.698571 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679bb779-7d18-45d8-adda-79e16c1bcea7-cert podName:679bb779-7d18-45d8-adda-79e16c1bcea7 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:50.198556685 +0000 UTC m=+327.293309724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/679bb779-7d18-45d8-adda-79e16c1bcea7-cert") pod "odh-model-controller-6dc94f689f-l9l8p" (UID: "679bb779-7d18-45d8-adda-79e16c1bcea7") : secret "odh-model-controller-webhook-cert" not found Jul 01 19:23:49.715596 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.715567 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktbqj\" (UniqueName: \"kubernetes.io/projected/679bb779-7d18-45d8-adda-79e16c1bcea7-kube-api-access-ktbqj\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:49.900017 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.899977 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:49.902399 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:49.902370 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f319e5b-20f6-426e-a24e-f7dba94d4c25-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-bfzbx\" (UID: \"2f319e5b-20f6-426e-a24e-f7dba94d4c25\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:50.095456 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.095361 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" Jul 01 19:23:50.203651 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.203617 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/679bb779-7d18-45d8-adda-79e16c1bcea7-cert\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:50.206100 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.206076 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/679bb779-7d18-45d8-adda-79e16c1bcea7-cert\") pod \"odh-model-controller-6dc94f689f-l9l8p\" (UID: \"679bb779-7d18-45d8-adda-79e16c1bcea7\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:50.238293 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.238251 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx"] Jul 01 19:23:50.242004 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:23:50.241977 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f319e5b_20f6_426e_a24e_f7dba94d4c25.slice/crio-2464370ade4cfb5be181d653d196e3479ca28946f8b710ee8b1162cb88015231 WatchSource:0}: Error finding container 2464370ade4cfb5be181d653d196e3479ca28946f8b710ee8b1162cb88015231: Status 404 returned error can't find the container with id 2464370ade4cfb5be181d653d196e3479ca28946f8b710ee8b1162cb88015231 Jul 01 19:23:50.432493 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.432462 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:50.570723 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.570678 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-l9l8p"] Jul 01 19:23:50.573639 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:23:50.573604 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679bb779_7d18_45d8_adda_79e16c1bcea7.slice/crio-548729eb309d2576ed8e8da486da22c4538211fe9474d674e6df7d396aa4b669 WatchSource:0}: Error finding container 548729eb309d2576ed8e8da486da22c4538211fe9474d674e6df7d396aa4b669: Status 404 returned error can't find the container with id 548729eb309d2576ed8e8da486da22c4538211fe9474d674e6df7d396aa4b669 Jul 01 19:23:50.574512 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.574488 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nfn9p"] Jul 01 19:23:50.579869 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.579843 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:50.582879 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.582861 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 19:23:50.590928 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.590909 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nfn9p"] Jul 01 19:23:50.708482 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.708391 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v2rx\" (UniqueName: \"kubernetes.io/projected/c8e747bf-4603-4d3c-9cb9-11be12298f92-kube-api-access-4v2rx\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:50.708482 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.708446 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8e747bf-4603-4d3c-9cb9-11be12298f92-tls-certs\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:50.809437 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.809407 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v2rx\" (UniqueName: \"kubernetes.io/projected/c8e747bf-4603-4d3c-9cb9-11be12298f92-kube-api-access-4v2rx\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:50.809602 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.809458 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8e747bf-4603-4d3c-9cb9-11be12298f92-tls-certs\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:50.809602 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:23:50.809562 2588 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 19:23:50.809672 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:23:50.809616 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e747bf-4603-4d3c-9cb9-11be12298f92-tls-certs podName:c8e747bf-4603-4d3c-9cb9-11be12298f92 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:51.309598557 +0000 UTC m=+328.404351596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c8e747bf-4603-4d3c-9cb9-11be12298f92-tls-certs") pod "model-serving-api-5dd488fc48-nfn9p" (UID: "c8e747bf-4603-4d3c-9cb9-11be12298f92") : secret "model-serving-api-tls" not found Jul 01 19:23:50.825704 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.825670 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v2rx\" (UniqueName: \"kubernetes.io/projected/c8e747bf-4603-4d3c-9cb9-11be12298f92-kube-api-access-4v2rx\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:50.836545 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.836511 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" event={"ID":"2f319e5b-20f6-426e-a24e-f7dba94d4c25","Type":"ContainerStarted","Data":"2464370ade4cfb5be181d653d196e3479ca28946f8b710ee8b1162cb88015231"} Jul 01 19:23:50.837703 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.837680 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" event={"ID":"679bb779-7d18-45d8-adda-79e16c1bcea7","Type":"ContainerStarted","Data":"548729eb309d2576ed8e8da486da22c4538211fe9474d674e6df7d396aa4b669"} Jul 01 19:23:50.843802 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.843777 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk"] Jul 01 19:23:50.847170 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.847153 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.853290 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.853267 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 19:23:50.853449 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.853267 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 19:23:50.853558 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.853542 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 19:23:50.853636 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.853616 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fn47x\"" Jul 01 19:23:50.853721 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.853703 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 19:23:50.871140 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.871117 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk"] Jul 01 19:23:50.910605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.910605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910466 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.910605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910495 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.910605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910546 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0e7a34-c7af-4662-91dd-9126b4a2a164-local-certs\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.910605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910579 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-cacerts\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.910605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910608 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nt6n\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-kube-api-access-7nt6n\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:50.911008 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:50.910685 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-token\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.011791 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.011697 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0e7a34-c7af-4662-91dd-9126b4a2a164-local-certs\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.011791 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.011759 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-cacerts\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.012009 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.011800 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nt6n\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-kube-api-access-7nt6n\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.012009 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.011885 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-token\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.012009 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.011942 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.012009 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.011978 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.012009 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.012001 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.012728 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.012689 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.014651 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.014624 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0e7a34-c7af-4662-91dd-9126b4a2a164-local-certs\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.014763 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.014705 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.014826 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.014805 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-cacerts\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.014877 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.014813 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.021252 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.021227 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-token\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.021396 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.021379 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nt6n\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-kube-api-access-7nt6n\") pod \"istiod-openshift-gateway-7574459656-9bvgk\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.157695 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.157661 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:51.316200 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.316113 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8e747bf-4603-4d3c-9cb9-11be12298f92-tls-certs\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:51.319471 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.319446 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8e747bf-4603-4d3c-9cb9-11be12298f92-tls-certs\") pod \"model-serving-api-5dd488fc48-nfn9p\" (UID: \"c8e747bf-4603-4d3c-9cb9-11be12298f92\") " pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:51.372020 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.371996 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk"] Jul 01 19:23:51.372903 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:23:51.372867 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0e7a34_c7af_4662_91dd_9126b4a2a164.slice/crio-d39bbcd1e1cdcdeaf62a0ce05e861d3e8aae1ea2950c794a5127be6cc32b3dc6 WatchSource:0}: Error finding container d39bbcd1e1cdcdeaf62a0ce05e861d3e8aae1ea2950c794a5127be6cc32b3dc6: Status 404 returned error can't find the container with id d39bbcd1e1cdcdeaf62a0ce05e861d3e8aae1ea2950c794a5127be6cc32b3dc6 Jul 01 19:23:51.491235 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.491196 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:51.673522 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.673483 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nfn9p"] Jul 01 19:23:51.677144 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:23:51.677109 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e747bf_4603_4d3c_9cb9_11be12298f92.slice/crio-f5dbdad492c04207eba38fcc28e486aaa5dbeadfbcc5f1ff835ebbf76d3d963b WatchSource:0}: Error finding container f5dbdad492c04207eba38fcc28e486aaa5dbeadfbcc5f1ff835ebbf76d3d963b: Status 404 returned error can't find the container with id f5dbdad492c04207eba38fcc28e486aaa5dbeadfbcc5f1ff835ebbf76d3d963b Jul 01 19:23:51.845320 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.845244 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" event={"ID":"c8e747bf-4603-4d3c-9cb9-11be12298f92","Type":"ContainerStarted","Data":"f5dbdad492c04207eba38fcc28e486aaa5dbeadfbcc5f1ff835ebbf76d3d963b"} Jul 01 19:23:51.846910 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:51.846877 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" event={"ID":"9e0e7a34-c7af-4662-91dd-9126b4a2a164","Type":"ContainerStarted","Data":"d39bbcd1e1cdcdeaf62a0ce05e861d3e8aae1ea2950c794a5127be6cc32b3dc6"} Jul 01 19:23:56.561653 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.561543 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:23:56.561653 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.561610 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 19:23:56.873328 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.873227 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" event={"ID":"9e0e7a34-c7af-4662-91dd-9126b4a2a164","Type":"ContainerStarted","Data":"245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10"} Jul 01 19:23:56.873328 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.873299 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:23:56.874692 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.874668 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" event={"ID":"2f319e5b-20f6-426e-a24e-f7dba94d4c25","Type":"ContainerStarted","Data":"26607e1a291b7a8cd44efa9819f3e02f68e002d8856fb68a85dd18e420da8dd9"} Jul 01 19:23:56.876194 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.876169 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" event={"ID":"679bb779-7d18-45d8-adda-79e16c1bcea7","Type":"ContainerStarted","Data":"afc038c88870494a9180f2956fb503b98be06d9d156cb1dd42d06b55186d1bf2"} Jul 01 19:23:56.876310 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.876221 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:23:56.877796 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.877771 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" event={"ID":"c8e747bf-4603-4d3c-9cb9-11be12298f92","Type":"ContainerStarted","Data":"6046c8f9fd64c600c07aabcdebf1fbff09ffca3c664dc7c8f815d517f3a74100"} Jul 01 19:23:56.877927 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.877911 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:23:56.899307 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.899256 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" podStartSLOduration=1.7127856609999998 podStartE2EDuration="6.899236527s" totalImagesPullingTime="5.186450866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:56.896794533 +0000 UTC m=+333.991547595" watchObservedRunningTime="2026-07-01 19:23:56.899236527 +0000 UTC m=+333.993989589" Jul 01 19:23:56.926052 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.925992 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" podStartSLOduration=1.94304644 podStartE2EDuration="7.925972023s" totalImagesPullingTime="5.982925583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:56.923042746 +0000 UTC m=+334.017795823" watchObservedRunningTime="2026-07-01 19:23:56.925972023 +0000 UTC m=+334.020725085" Jul 01 19:23:56.945805 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.945747 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" podStartSLOduration=2.005955211 podStartE2EDuration="6.945731248s" totalImagesPullingTime="4.939776037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:56.944000087 +0000 UTC m=+334.038753148" watchObservedRunningTime="2026-07-01 19:23:56.945731248 +0000 UTC m=+334.040484286" Jul 01 19:23:56.967845 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:56.967794 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-bfzbx" podStartSLOduration=1.650158286 podStartE2EDuration="7.967779206s" totalImagesPullingTime="6.31762092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:56.966172879 +0000 UTC m=+334.060925938" watchObservedRunningTime="2026-07-01 19:23:56.967779206 +0000 UTC m=+334.062532266" Jul 01 19:23:57.884400 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:57.884369 2588 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9bvgk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 19:23:57.884765 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:23:57.884429 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" podUID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:24:00.883615 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:00.883588 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:24:01.191441 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.191348 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5464bb7789-drcww"] Jul 01 19:24:01.194746 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.194724 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.207570 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.207550 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:24:01.208464 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.208441 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 19:24:01.208464 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.208460 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 19:24:01.208629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.208495 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 19:24:01.208629 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.208592 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xvzzf\"" Jul 01 19:24:01.209333 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.209319 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 19:24:01.249738 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.249705 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5464bb7789-drcww"] Jul 01 19:24:01.311925 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.311889 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkvcp\" (UniqueName: \"kubernetes.io/projected/c3fdf827-b4ee-4444-b296-343be242b2d5-kube-api-access-nkvcp\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.312114 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.311942 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3fdf827-b4ee-4444-b296-343be242b2d5-metrics-cert\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.312174 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.312130 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3fdf827-b4ee-4444-b296-343be242b2d5-cert\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.312174 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.312163 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3fdf827-b4ee-4444-b296-343be242b2d5-manager-config\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.412886 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.412842 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3fdf827-b4ee-4444-b296-343be242b2d5-cert\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.413100 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.412897 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3fdf827-b4ee-4444-b296-343be242b2d5-manager-config\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.413100 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.412934 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkvcp\" (UniqueName: \"kubernetes.io/projected/c3fdf827-b4ee-4444-b296-343be242b2d5-kube-api-access-nkvcp\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.413100 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.412971 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3fdf827-b4ee-4444-b296-343be242b2d5-metrics-cert\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.413868 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.413839 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3fdf827-b4ee-4444-b296-343be242b2d5-manager-config\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.415803 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.415772 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3fdf827-b4ee-4444-b296-343be242b2d5-metrics-cert\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.415923 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.415785 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3fdf827-b4ee-4444-b296-343be242b2d5-cert\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.436517 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.436476 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkvcp\" (UniqueName: \"kubernetes.io/projected/c3fdf827-b4ee-4444-b296-343be242b2d5-kube-api-access-nkvcp\") pod \"lws-controller-manager-5464bb7789-drcww\" (UID: \"c3fdf827-b4ee-4444-b296-343be242b2d5\") " pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.504205 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.504084 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:01.720931 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:24:01.720897 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fdf827_b4ee_4444_b296_343be242b2d5.slice/crio-79f925c606f28dce9f21eed892d4a38c2b24be3aee810586547be6e72a9180b7 WatchSource:0}: Error finding container 79f925c606f28dce9f21eed892d4a38c2b24be3aee810586547be6e72a9180b7: Status 404 returned error can't find the container with id 79f925c606f28dce9f21eed892d4a38c2b24be3aee810586547be6e72a9180b7 Jul 01 19:24:01.722137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.722114 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5464bb7789-drcww"] Jul 01 19:24:01.794837 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.794728 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk"] Jul 01 19:24:01.794968 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.794911 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" podUID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" containerName="discovery" containerID="cri-o://245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10" gracePeriod=30 Jul 01 19:24:01.903596 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:01.903561 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" event={"ID":"c3fdf827-b4ee-4444-b296-343be242b2d5","Type":"ContainerStarted","Data":"79f925c606f28dce9f21eed892d4a38c2b24be3aee810586547be6e72a9180b7"} Jul 01 19:24:02.028229 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.028206 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:24:02.118996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.118896 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nt6n\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-kube-api-access-7nt6n\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.118996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.118940 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0e7a34-c7af-4662-91dd-9126b4a2a164-local-certs\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.118996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.118962 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-dns-cert\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.118996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.118996 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-cacerts\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.119370 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.119042 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-ca-configmap\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.119370 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.119093 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-token\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.119370 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.119134 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-kubeconfig\") pod \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\" (UID: \"9e0e7a34-c7af-4662-91dd-9126b4a2a164\") " Jul 01 19:24:02.119577 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.119534 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:24:02.121353 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.121311 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0e7a34-c7af-4662-91dd-9126b4a2a164-local-certs" (OuterVolumeSpecName: "local-certs") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:02.121491 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.121408 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-kube-api-access-7nt6n" (OuterVolumeSpecName: "kube-api-access-7nt6n") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "kube-api-access-7nt6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:02.121597 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.121580 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:02.121653 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.121614 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-cacerts" (OuterVolumeSpecName: "cacerts") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:02.121692 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.121665 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:02.121725 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.121689 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e0e7a34-c7af-4662-91dd-9126b4a2a164" (UID: "9e0e7a34-c7af-4662-91dd-9126b4a2a164"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:02.219952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219916 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nt6n\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-kube-api-access-7nt6n\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.219952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219947 2588 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0e7a34-c7af-4662-91dd-9126b4a2a164-local-certs\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.219952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219957 2588 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-dns-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.220218 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219966 2588 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-cacerts\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.220218 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219975 2588 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-csr-ca-configmap\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.220218 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219984 2588 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-token\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.220218 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.219992 2588 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e0e7a34-c7af-4662-91dd-9126b4a2a164-istio-kubeconfig\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:24:02.910794 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.910756 2588 generic.go:356] "Generic (PLEG): container finished" podID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" containerID="245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10" exitCode=0 Jul 01 19:24:02.911216 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.910810 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" Jul 01 19:24:02.911216 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.910848 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" event={"ID":"9e0e7a34-c7af-4662-91dd-9126b4a2a164","Type":"ContainerDied","Data":"245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10"} Jul 01 19:24:02.911216 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.910915 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk" event={"ID":"9e0e7a34-c7af-4662-91dd-9126b4a2a164","Type":"ContainerDied","Data":"d39bbcd1e1cdcdeaf62a0ce05e861d3e8aae1ea2950c794a5127be6cc32b3dc6"} Jul 01 19:24:02.911216 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.910945 2588 scope.go:117] "RemoveContainer" containerID="245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10" Jul 01 19:24:02.920539 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.920520 2588 scope.go:117] "RemoveContainer" containerID="245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10" Jul 01 19:24:02.920803 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:24:02.920784 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10\": container with ID starting with 245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10 not found: ID does not exist" containerID="245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10" Jul 01 19:24:02.920848 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.920812 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10"} err="failed to get container status \"245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10\": rpc error: code = NotFound desc = could not find container \"245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10\": container with ID starting with 245d106e9ad12bb1dddcbcc503ba8b8eb39f1695828878cbc6cb17dce66eaf10 not found: ID does not exist" Jul 01 19:24:02.935425 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.935388 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk"] Jul 01 19:24:02.944653 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:02.944624 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9bvgk"] Jul 01 19:24:03.333231 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:03.333161 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" path="/var/lib/kubelet/pods/9e0e7a34-c7af-4662-91dd-9126b4a2a164/volumes" Jul 01 19:24:04.922351 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:04.922302 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" event={"ID":"c3fdf827-b4ee-4444-b296-343be242b2d5","Type":"ContainerStarted","Data":"1e52a6141ce6226642957fc3560960ef0dba4ae953f53da703707b6bbb0ecadf"} Jul 01 19:24:04.922772 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:04.922447 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:24:04.941967 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:04.941919 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" podStartSLOduration=1.138632781 podStartE2EDuration="3.94190285s" totalImagesPullingTime="2.803270069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:04.940619008 +0000 UTC m=+342.035372071" watchObservedRunningTime="2026-07-01 19:24:04.94190285 +0000 UTC m=+342.036655912" Jul 01 19:24:07.884733 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:07.884706 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-l9l8p" Jul 01 19:24:07.886719 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:07.886697 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-nfn9p" Jul 01 19:24:15.929302 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:24:15.929276 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5464bb7789-drcww" Jul 01 19:25:46.485262 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.485185 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9"] Jul 01 19:25:46.485719 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.485643 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" containerName="discovery" Jul 01 19:25:46.485719 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.485663 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" containerName="discovery" Jul 01 19:25:46.485800 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.485781 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e0e7a34-c7af-4662-91dd-9126b4a2a164" containerName="discovery" Jul 01 19:25:46.488727 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.488710 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.491594 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.491563 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 19:25:46.491729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.491599 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 19:25:46.491729 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.491572 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:25:46.492513 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.492497 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:25:46.492595 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.492498 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j8mtr\"" Jul 01 19:25:46.498615 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.498590 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9"] Jul 01 19:25:46.613952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.613921 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/939a536e-e4d2-4e58-9e9e-82134b28224f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.614122 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.614052 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/939a536e-e4d2-4e58-9e9e-82134b28224f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.614122 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.614094 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbrj\" (UniqueName: \"kubernetes.io/projected/939a536e-e4d2-4e58-9e9e-82134b28224f-kube-api-access-wqbrj\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.714851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.714817 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/939a536e-e4d2-4e58-9e9e-82134b28224f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.714851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.714854 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbrj\" (UniqueName: \"kubernetes.io/projected/939a536e-e4d2-4e58-9e9e-82134b28224f-kube-api-access-wqbrj\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.715052 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.714891 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/939a536e-e4d2-4e58-9e9e-82134b28224f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.715627 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.715600 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/939a536e-e4d2-4e58-9e9e-82134b28224f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.717256 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.717234 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/939a536e-e4d2-4e58-9e9e-82134b28224f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.723933 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.723907 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbrj\" (UniqueName: \"kubernetes.io/projected/939a536e-e4d2-4e58-9e9e-82134b28224f-kube-api-access-wqbrj\") pod \"kuadrant-console-plugin-66b5774985-ck7f9\" (UID: \"939a536e-e4d2-4e58-9e9e-82134b28224f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.799084 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.798995 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" Jul 01 19:25:46.932107 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:46.932080 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9"] Jul 01 19:25:46.934784 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:25:46.934758 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod939a536e_e4d2_4e58_9e9e_82134b28224f.slice/crio-f3a46ebf28e6356a68430087e83ad4f9ae527a2d945542a7b13d0ce3e93ba121 WatchSource:0}: Error finding container f3a46ebf28e6356a68430087e83ad4f9ae527a2d945542a7b13d0ce3e93ba121: Status 404 returned error can't find the container with id f3a46ebf28e6356a68430087e83ad4f9ae527a2d945542a7b13d0ce3e93ba121 Jul 01 19:25:47.366402 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:25:47.366367 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" event={"ID":"939a536e-e4d2-4e58-9e9e-82134b28224f","Type":"ContainerStarted","Data":"f3a46ebf28e6356a68430087e83ad4f9ae527a2d945542a7b13d0ce3e93ba121"} Jul 01 19:26:11.497496 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:11.497462 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" event={"ID":"939a536e-e4d2-4e58-9e9e-82134b28224f","Type":"ContainerStarted","Data":"51842009aa2f41a765ee3f59e127f8e96bb76ff6016be381c86a91ab2ddd2e59"} Jul 01 19:26:11.519401 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:11.519320 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ck7f9" podStartSLOduration=1.199545724 podStartE2EDuration="25.519306166s" totalImagesPullingTime="24.319760442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:11.518753884 +0000 UTC m=+468.613506945" watchObservedRunningTime="2026-07-01 19:26:11.519306166 +0000 UTC m=+468.614059226" Jul 01 19:26:39.475015 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.474985 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:26:39.656984 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.656942 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:26:39.656984 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.656979 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:26:39.657232 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.657079 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.659805 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.659775 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 19:26:39.791910 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.791838 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn8tl\" (UniqueName: \"kubernetes.io/projected/c74f1bb5-0161-4b99-91f9-65feafe4cef1-kube-api-access-qn8tl\") pod \"limitador-limitador-54d6d988d5-56lpr\" (UID: \"c74f1bb5-0161-4b99-91f9-65feafe4cef1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.791910 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.791875 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c74f1bb5-0161-4b99-91f9-65feafe4cef1-config-file\") pod \"limitador-limitador-54d6d988d5-56lpr\" (UID: \"c74f1bb5-0161-4b99-91f9-65feafe4cef1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.892875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.892839 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn8tl\" (UniqueName: \"kubernetes.io/projected/c74f1bb5-0161-4b99-91f9-65feafe4cef1-kube-api-access-qn8tl\") pod \"limitador-limitador-54d6d988d5-56lpr\" (UID: \"c74f1bb5-0161-4b99-91f9-65feafe4cef1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.893048 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.892881 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c74f1bb5-0161-4b99-91f9-65feafe4cef1-config-file\") pod \"limitador-limitador-54d6d988d5-56lpr\" (UID: \"c74f1bb5-0161-4b99-91f9-65feafe4cef1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.893528 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.893506 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c74f1bb5-0161-4b99-91f9-65feafe4cef1-config-file\") pod \"limitador-limitador-54d6d988d5-56lpr\" (UID: \"c74f1bb5-0161-4b99-91f9-65feafe4cef1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.901699 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.901675 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn8tl\" (UniqueName: \"kubernetes.io/projected/c74f1bb5-0161-4b99-91f9-65feafe4cef1-kube-api-access-qn8tl\") pod \"limitador-limitador-54d6d988d5-56lpr\" (UID: \"c74f1bb5-0161-4b99-91f9-65feafe4cef1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:39.968118 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:39.968085 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:40.124641 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.124612 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-p7j4v"] Jul 01 19:26:40.130688 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.130666 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:26:40.133387 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.133363 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pvmzj\"" Jul 01 19:26:40.134932 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.134911 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p7j4v"] Jul 01 19:26:40.146052 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.146020 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:26:40.148959 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:26:40.148933 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74f1bb5_0161_4b99_91f9_65feafe4cef1.slice/crio-99be1dee962d9cd7eb4f519e4070dc92e2e1f22b2887b8e57ac1ab922de877e0 WatchSource:0}: Error finding container 99be1dee962d9cd7eb4f519e4070dc92e2e1f22b2887b8e57ac1ab922de877e0: Status 404 returned error can't find the container with id 99be1dee962d9cd7eb4f519e4070dc92e2e1f22b2887b8e57ac1ab922de877e0 Jul 01 19:26:40.295774 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.295742 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pt9\" (UniqueName: \"kubernetes.io/projected/d3c149e7-da19-4e01-8783-976631ce9ee7-kube-api-access-54pt9\") pod \"authorino-75d556bd77-p7j4v\" (UID: \"d3c149e7-da19-4e01-8783-976631ce9ee7\") " pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:26:40.396531 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.396490 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54pt9\" (UniqueName: \"kubernetes.io/projected/d3c149e7-da19-4e01-8783-976631ce9ee7-kube-api-access-54pt9\") pod \"authorino-75d556bd77-p7j4v\" (UID: \"d3c149e7-da19-4e01-8783-976631ce9ee7\") " pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:26:40.405295 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.405269 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pt9\" (UniqueName: \"kubernetes.io/projected/d3c149e7-da19-4e01-8783-976631ce9ee7-kube-api-access-54pt9\") pod \"authorino-75d556bd77-p7j4v\" (UID: \"d3c149e7-da19-4e01-8783-976631ce9ee7\") " pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:26:40.441194 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.441168 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:26:40.635835 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.635788 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" event={"ID":"c74f1bb5-0161-4b99-91f9-65feafe4cef1","Type":"ContainerStarted","Data":"99be1dee962d9cd7eb4f519e4070dc92e2e1f22b2887b8e57ac1ab922de877e0"} Jul 01 19:26:40.658808 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:40.658779 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p7j4v"] Jul 01 19:26:40.661006 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:26:40.660979 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3c149e7_da19_4e01_8783_976631ce9ee7.slice/crio-68e724890ad28f181e94375d77754be8268f1ccac9801bb13769b79c4e9aedcd WatchSource:0}: Error finding container 68e724890ad28f181e94375d77754be8268f1ccac9801bb13769b79c4e9aedcd: Status 404 returned error can't find the container with id 68e724890ad28f181e94375d77754be8268f1ccac9801bb13769b79c4e9aedcd Jul 01 19:26:41.645564 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:41.645522 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p7j4v" event={"ID":"d3c149e7-da19-4e01-8783-976631ce9ee7","Type":"ContainerStarted","Data":"68e724890ad28f181e94375d77754be8268f1ccac9801bb13769b79c4e9aedcd"} Jul 01 19:26:44.662223 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:44.662184 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" event={"ID":"c74f1bb5-0161-4b99-91f9-65feafe4cef1","Type":"ContainerStarted","Data":"8cfc6e12910d662099cfb1d279e53ddc71e1c202ec16033a86a02506dbb69e34"} Jul 01 19:26:44.662724 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:44.662250 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:26:44.663848 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:44.663825 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p7j4v" event={"ID":"d3c149e7-da19-4e01-8783-976631ce9ee7","Type":"ContainerStarted","Data":"dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75"} Jul 01 19:26:44.693230 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:44.693178 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" podStartSLOduration=1.384730706 podStartE2EDuration="5.693162642s" totalImagesPullingTime="4.308431936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:44.690812881 +0000 UTC m=+501.785565942" watchObservedRunningTime="2026-07-01 19:26:44.693162642 +0000 UTC m=+501.787915702" Jul 01 19:26:44.717845 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:44.717756 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-p7j4v" podStartSLOduration=0.875262624 podStartE2EDuration="4.717739938s" totalImagesPullingTime="3.842477314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:44.716787905 +0000 UTC m=+501.811540968" watchObservedRunningTime="2026-07-01 19:26:44.717739938 +0000 UTC m=+501.812492999" Jul 01 19:26:55.669786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:26:55.669755 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-56lpr" Jul 01 19:28:14.337015 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.336972 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qwwt2"] Jul 01 19:28:14.340407 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.340390 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:14.368115 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.368081 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qwwt2"] Jul 01 19:28:14.528572 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.528534 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx78k\" (UniqueName: \"kubernetes.io/projected/8bab47fc-33f2-4ed9-b297-2ebee3572b72-kube-api-access-jx78k\") pod \"authorino-5d4b67c446-qwwt2\" (UID: \"8bab47fc-33f2-4ed9-b297-2ebee3572b72\") " pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:14.553764 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.553730 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qwwt2"] Jul 01 19:28:14.553992 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:28:14.553973 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jx78k], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-qwwt2" podUID="8bab47fc-33f2-4ed9-b297-2ebee3572b72" Jul 01 19:28:14.583867 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.583831 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ccf6884c6-l5wnn"] Jul 01 19:28:14.587293 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.587236 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:14.598586 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.598566 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ccf6884c6-l5wnn"] Jul 01 19:28:14.629638 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.629615 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx78k\" (UniqueName: \"kubernetes.io/projected/8bab47fc-33f2-4ed9-b297-2ebee3572b72-kube-api-access-jx78k\") pod \"authorino-5d4b67c446-qwwt2\" (UID: \"8bab47fc-33f2-4ed9-b297-2ebee3572b72\") " pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:14.639557 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.639529 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx78k\" (UniqueName: \"kubernetes.io/projected/8bab47fc-33f2-4ed9-b297-2ebee3572b72-kube-api-access-jx78k\") pod \"authorino-5d4b67c446-qwwt2\" (UID: \"8bab47fc-33f2-4ed9-b297-2ebee3572b72\") " pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:14.730138 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.730105 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdk28\" (UniqueName: \"kubernetes.io/projected/e41b606f-68c3-46f5-a981-7f303af653ab-kube-api-access-gdk28\") pod \"authorino-ccf6884c6-l5wnn\" (UID: \"e41b606f-68c3-46f5-a981-7f303af653ab\") " pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:14.753514 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.753480 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ccf6884c6-l5wnn"] Jul 01 19:28:14.753750 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:28:14.753732 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gdk28], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-ccf6884c6-l5wnn" podUID="e41b606f-68c3-46f5-a981-7f303af653ab" Jul 01 19:28:14.785864 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.785831 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57cd98f6d4-74snn"] Jul 01 19:28:14.789270 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.789252 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:14.791912 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.791895 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 19:28:14.800937 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.800915 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cd98f6d4-74snn"] Jul 01 19:28:14.831177 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.831152 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdk28\" (UniqueName: \"kubernetes.io/projected/e41b606f-68c3-46f5-a981-7f303af653ab-kube-api-access-gdk28\") pod \"authorino-ccf6884c6-l5wnn\" (UID: \"e41b606f-68c3-46f5-a981-7f303af653ab\") " pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:14.839964 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.839908 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdk28\" (UniqueName: \"kubernetes.io/projected/e41b606f-68c3-46f5-a981-7f303af653ab-kube-api-access-gdk28\") pod \"authorino-ccf6884c6-l5wnn\" (UID: \"e41b606f-68c3-46f5-a981-7f303af653ab\") " pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:14.932630 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.932592 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4hn\" (UniqueName: \"kubernetes.io/projected/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-kube-api-access-mr4hn\") pod \"authorino-57cd98f6d4-74snn\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:14.932800 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:14.932724 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-tls-cert\") pod \"authorino-57cd98f6d4-74snn\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:15.033252 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.033212 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-tls-cert\") pod \"authorino-57cd98f6d4-74snn\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:15.033462 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.033282 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4hn\" (UniqueName: \"kubernetes.io/projected/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-kube-api-access-mr4hn\") pod \"authorino-57cd98f6d4-74snn\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:15.035824 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.035799 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-tls-cert\") pod \"authorino-57cd98f6d4-74snn\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:15.041828 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.041809 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4hn\" (UniqueName: \"kubernetes.io/projected/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-kube-api-access-mr4hn\") pod \"authorino-57cd98f6d4-74snn\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:15.080189 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.080159 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:15.080333 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.080159 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:15.087414 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.087392 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:15.090371 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.090315 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:15.098020 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.098004 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:28:15.229867 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.229841 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cd98f6d4-74snn"] Jul 01 19:28:15.230970 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:28:15.230942 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c2ba6a2_b46e_4f64_acb2_ecc8f6932bdc.slice/crio-dfcb3bd708d63dd9fe62c51e6388e54e9f86b6135d059479a8405a5efb458fd9 WatchSource:0}: Error finding container dfcb3bd708d63dd9fe62c51e6388e54e9f86b6135d059479a8405a5efb458fd9: Status 404 returned error can't find the container with id dfcb3bd708d63dd9fe62c51e6388e54e9f86b6135d059479a8405a5efb458fd9 Jul 01 19:28:15.234880 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.234863 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx78k\" (UniqueName: \"kubernetes.io/projected/8bab47fc-33f2-4ed9-b297-2ebee3572b72-kube-api-access-jx78k\") pod \"8bab47fc-33f2-4ed9-b297-2ebee3572b72\" (UID: \"8bab47fc-33f2-4ed9-b297-2ebee3572b72\") " Jul 01 19:28:15.234952 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.234888 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdk28\" (UniqueName: \"kubernetes.io/projected/e41b606f-68c3-46f5-a981-7f303af653ab-kube-api-access-gdk28\") pod \"e41b606f-68c3-46f5-a981-7f303af653ab\" (UID: \"e41b606f-68c3-46f5-a981-7f303af653ab\") " Jul 01 19:28:15.236936 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.236910 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41b606f-68c3-46f5-a981-7f303af653ab-kube-api-access-gdk28" (OuterVolumeSpecName: "kube-api-access-gdk28") pod "e41b606f-68c3-46f5-a981-7f303af653ab" (UID: "e41b606f-68c3-46f5-a981-7f303af653ab"). InnerVolumeSpecName "kube-api-access-gdk28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:28:15.237012 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.236957 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bab47fc-33f2-4ed9-b297-2ebee3572b72-kube-api-access-jx78k" (OuterVolumeSpecName: "kube-api-access-jx78k") pod "8bab47fc-33f2-4ed9-b297-2ebee3572b72" (UID: "8bab47fc-33f2-4ed9-b297-2ebee3572b72"). InnerVolumeSpecName "kube-api-access-jx78k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:28:15.335678 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.335640 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx78k\" (UniqueName: \"kubernetes.io/projected/8bab47fc-33f2-4ed9-b297-2ebee3572b72-kube-api-access-jx78k\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:28:15.335678 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:15.335664 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdk28\" (UniqueName: \"kubernetes.io/projected/e41b606f-68c3-46f5-a981-7f303af653ab-kube-api-access-gdk28\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:28:16.087121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.087016 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cd98f6d4-74snn" event={"ID":"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc","Type":"ContainerStarted","Data":"6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f"} Jul 01 19:28:16.087121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.087075 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ccf6884c6-l5wnn" Jul 01 19:28:16.087121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.087074 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cd98f6d4-74snn" event={"ID":"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc","Type":"ContainerStarted","Data":"dfcb3bd708d63dd9fe62c51e6388e54e9f86b6135d059479a8405a5efb458fd9"} Jul 01 19:28:16.087541 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.087186 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qwwt2" Jul 01 19:28:16.103594 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.103541 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57cd98f6d4-74snn" podStartSLOduration=1.625123509 podStartE2EDuration="2.103525121s" totalImagesPullingTime="478.401612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:16.102687015 +0000 UTC m=+593.197440077" watchObservedRunningTime="2026-07-01 19:28:16.103525121 +0000 UTC m=+593.198278182" Jul 01 19:28:16.133523 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.133482 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ccf6884c6-l5wnn"] Jul 01 19:28:16.138786 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.138758 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p7j4v"] Jul 01 19:28:16.139588 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.139552 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-p7j4v" podUID="d3c149e7-da19-4e01-8783-976631ce9ee7" containerName="authorino" containerID="cri-o://dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75" gracePeriod=30 Jul 01 19:28:16.140818 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.140795 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-ccf6884c6-l5wnn"] Jul 01 19:28:16.165742 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.165714 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qwwt2"] Jul 01 19:28:16.169012 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.168988 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qwwt2"] Jul 01 19:28:16.372758 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.372734 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:28:16.546887 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.546857 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54pt9\" (UniqueName: \"kubernetes.io/projected/d3c149e7-da19-4e01-8783-976631ce9ee7-kube-api-access-54pt9\") pod \"d3c149e7-da19-4e01-8783-976631ce9ee7\" (UID: \"d3c149e7-da19-4e01-8783-976631ce9ee7\") " Jul 01 19:28:16.548946 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.548923 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c149e7-da19-4e01-8783-976631ce9ee7-kube-api-access-54pt9" (OuterVolumeSpecName: "kube-api-access-54pt9") pod "d3c149e7-da19-4e01-8783-976631ce9ee7" (UID: "d3c149e7-da19-4e01-8783-976631ce9ee7"). InnerVolumeSpecName "kube-api-access-54pt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:28:16.647789 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:16.647763 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54pt9\" (UniqueName: \"kubernetes.io/projected/d3c149e7-da19-4e01-8783-976631ce9ee7-kube-api-access-54pt9\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:28:17.092723 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.092634 2588 generic.go:356] "Generic (PLEG): container finished" podID="d3c149e7-da19-4e01-8783-976631ce9ee7" containerID="dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75" exitCode=0 Jul 01 19:28:17.092723 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.092673 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p7j4v" Jul 01 19:28:17.093227 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.092716 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p7j4v" event={"ID":"d3c149e7-da19-4e01-8783-976631ce9ee7","Type":"ContainerDied","Data":"dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75"} Jul 01 19:28:17.093227 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.092755 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p7j4v" event={"ID":"d3c149e7-da19-4e01-8783-976631ce9ee7","Type":"ContainerDied","Data":"68e724890ad28f181e94375d77754be8268f1ccac9801bb13769b79c4e9aedcd"} Jul 01 19:28:17.093227 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.092773 2588 scope.go:117] "RemoveContainer" containerID="dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75" Jul 01 19:28:17.101326 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.101309 2588 scope.go:117] "RemoveContainer" containerID="dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75" Jul 01 19:28:17.101576 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:28:17.101557 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75\": container with ID starting with dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75 not found: ID does not exist" containerID="dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75" Jul 01 19:28:17.101620 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.101584 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75"} err="failed to get container status \"dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75\": rpc error: code = NotFound desc = could not find container \"dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75\": container with ID starting with dc1c30117082cce697be6fa72ecc6f7f96fbf8df0d3add0519cd5b308313dd75 not found: ID does not exist" Jul 01 19:28:17.116091 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.116054 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p7j4v"] Jul 01 19:28:17.119312 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.119292 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p7j4v"] Jul 01 19:28:17.332461 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.332429 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bab47fc-33f2-4ed9-b297-2ebee3572b72" path="/var/lib/kubelet/pods/8bab47fc-33f2-4ed9-b297-2ebee3572b72/volumes" Jul 01 19:28:17.332714 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.332702 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3c149e7-da19-4e01-8783-976631ce9ee7" path="/var/lib/kubelet/pods/d3c149e7-da19-4e01-8783-976631ce9ee7/volumes" Jul 01 19:28:17.332991 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:17.332980 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41b606f-68c3-46f5-a981-7f303af653ab" path="/var/lib/kubelet/pods/e41b606f-68c3-46f5-a981-7f303af653ab/volumes" Jul 01 19:28:23.296789 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:23.296763 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:28:23.304536 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:23.304517 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:28:58.027258 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:28:58.027166 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:29:48.495073 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.495031 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57d68f7998-sm5r9"] Jul 01 19:29:48.495720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.495482 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c149e7-da19-4e01-8783-976631ce9ee7" containerName="authorino" Jul 01 19:29:48.495720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.495498 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c149e7-da19-4e01-8783-976631ce9ee7" containerName="authorino" Jul 01 19:29:48.495720 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.495582 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c149e7-da19-4e01-8783-976631ce9ee7" containerName="authorino" Jul 01 19:29:48.498750 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.498732 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.502237 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.502213 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 19:29:48.508419 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.508393 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57d68f7998-sm5r9"] Jul 01 19:29:48.550833 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.550799 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvmd\" (UniqueName: \"kubernetes.io/projected/14e84d46-a420-4482-aeb1-5b26f33a050c-kube-api-access-2tvmd\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.551011 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.550841 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14e84d46-a420-4482-aeb1-5b26f33a050c-tls-cert\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.551011 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.550917 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/14e84d46-a420-4482-aeb1-5b26f33a050c-oidc-ca\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.651432 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.651396 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/14e84d46-a420-4482-aeb1-5b26f33a050c-oidc-ca\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.651597 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.651492 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvmd\" (UniqueName: \"kubernetes.io/projected/14e84d46-a420-4482-aeb1-5b26f33a050c-kube-api-access-2tvmd\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.651597 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.651532 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14e84d46-a420-4482-aeb1-5b26f33a050c-tls-cert\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.652184 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.652167 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/14e84d46-a420-4482-aeb1-5b26f33a050c-oidc-ca\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.653926 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.653906 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14e84d46-a420-4482-aeb1-5b26f33a050c-tls-cert\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.659221 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.659192 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvmd\" (UniqueName: \"kubernetes.io/projected/14e84d46-a420-4482-aeb1-5b26f33a050c-kube-api-access-2tvmd\") pod \"authorino-57d68f7998-sm5r9\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.809176 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.809097 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:29:48.940435 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.940311 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57d68f7998-sm5r9"] Jul 01 19:29:48.942842 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:29:48.942812 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14e84d46_a420_4482_aeb1_5b26f33a050c.slice/crio-3b2699aa522b400da6a0096c8abf30b107be8a6e973a0ab892a298049eafa3d8 WatchSource:0}: Error finding container 3b2699aa522b400da6a0096c8abf30b107be8a6e973a0ab892a298049eafa3d8: Status 404 returned error can't find the container with id 3b2699aa522b400da6a0096c8abf30b107be8a6e973a0ab892a298049eafa3d8 Jul 01 19:29:48.944254 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:48.944228 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:29:49.503999 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:49.503967 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d68f7998-sm5r9" event={"ID":"14e84d46-a420-4482-aeb1-5b26f33a050c","Type":"ContainerStarted","Data":"3b2699aa522b400da6a0096c8abf30b107be8a6e973a0ab892a298049eafa3d8"} Jul 01 19:29:50.509953 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.509912 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d68f7998-sm5r9" event={"ID":"14e84d46-a420-4482-aeb1-5b26f33a050c","Type":"ContainerStarted","Data":"74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da"} Jul 01 19:29:50.533154 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.533099 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57d68f7998-sm5r9" podStartSLOduration=1.933291955 podStartE2EDuration="2.533083159s" totalImagesPullingTime="599.791204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:50.531928515 +0000 UTC m=+687.626681576" watchObservedRunningTime="2026-07-01 19:29:50.533083159 +0000 UTC m=+687.627836216" Jul 01 19:29:50.559507 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.559470 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cd98f6d4-74snn"] Jul 01 19:29:50.559666 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.559632 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57cd98f6d4-74snn" podUID="3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" containerName="authorino" containerID="cri-o://6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f" gracePeriod=30 Jul 01 19:29:50.808966 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.808936 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:29:50.867167 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.867133 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr4hn\" (UniqueName: \"kubernetes.io/projected/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-kube-api-access-mr4hn\") pod \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " Jul 01 19:29:50.867361 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.867172 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-tls-cert\") pod \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\" (UID: \"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc\") " Jul 01 19:29:50.869298 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.869271 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-kube-api-access-mr4hn" (OuterVolumeSpecName: "kube-api-access-mr4hn") pod "3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" (UID: "3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc"). InnerVolumeSpecName "kube-api-access-mr4hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:29:50.877269 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.877242 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" (UID: "3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:29:50.968607 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.968569 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr4hn\" (UniqueName: \"kubernetes.io/projected/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-kube-api-access-mr4hn\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:29:50.968607 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:50.968600 2588 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc-tls-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:29:51.516510 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.516476 2588 generic.go:356] "Generic (PLEG): container finished" podID="3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" containerID="6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f" exitCode=0 Jul 01 19:29:51.516917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.516522 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cd98f6d4-74snn" Jul 01 19:29:51.516917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.516555 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cd98f6d4-74snn" event={"ID":"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc","Type":"ContainerDied","Data":"6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f"} Jul 01 19:29:51.516917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.516600 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cd98f6d4-74snn" event={"ID":"3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc","Type":"ContainerDied","Data":"dfcb3bd708d63dd9fe62c51e6388e54e9f86b6135d059479a8405a5efb458fd9"} Jul 01 19:29:51.516917 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.516617 2588 scope.go:117] "RemoveContainer" containerID="6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f" Jul 01 19:29:51.524990 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.524971 2588 scope.go:117] "RemoveContainer" containerID="6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f" Jul 01 19:29:51.525267 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:29:51.525247 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f\": container with ID starting with 6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f not found: ID does not exist" containerID="6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f" Jul 01 19:29:51.525321 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.525278 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f"} err="failed to get container status \"6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f\": rpc error: code = NotFound desc = could not find container \"6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f\": container with ID starting with 6d82b686ae8cb669cd9969f0de1ade4e48588a6cb0ef4366406ca504a6e5f99f not found: ID does not exist" Jul 01 19:29:51.552231 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.552207 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cd98f6d4-74snn"] Jul 01 19:29:51.556325 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:51.556300 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57cd98f6d4-74snn"] Jul 01 19:29:53.331851 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:29:53.331820 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" path="/var/lib/kubelet/pods/3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc/volumes" Jul 01 19:30:07.000306 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:07.000266 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:30:26.254681 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.254649 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-h59p5"] Jul 01 19:30:26.255198 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.255180 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" containerName="authorino" Jul 01 19:30:26.255245 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.255200 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" containerName="authorino" Jul 01 19:30:26.255280 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.255260 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2ba6a2-b46e-4f64-acb2-ecc8f6932bdc" containerName="authorino" Jul 01 19:30:26.259676 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.259655 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.263312 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.263290 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j8gzm\"" Jul 01 19:30:26.263507 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.263488 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 19:30:26.263574 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.263559 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 19:30:26.264080 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.264049 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 19:30:26.276679 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.276652 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-h59p5"] Jul 01 19:30:26.370341 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.370307 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.370532 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.370345 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.370532 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.370403 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.370532 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.370504 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf36a00-ae1e-46ce-a927-0069473283e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.370676 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.370549 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86l4n\" (UniqueName: \"kubernetes.io/projected/9cf36a00-ae1e-46ce-a927-0069473283e2-kube-api-access-86l4n\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.471909 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.471867 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf36a00-ae1e-46ce-a927-0069473283e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.472121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.471917 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86l4n\" (UniqueName: \"kubernetes.io/projected/9cf36a00-ae1e-46ce-a927-0069473283e2-kube-api-access-86l4n\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.472121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.471972 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.472121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.471996 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.472121 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.472032 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.472466 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.472443 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.472520 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.472455 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.474283 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.474263 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cf36a00-ae1e-46ce-a927-0069473283e2-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.474464 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.474447 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cf36a00-ae1e-46ce-a927-0069473283e2-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.481627 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.481600 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86l4n\" (UniqueName: \"kubernetes.io/projected/9cf36a00-ae1e-46ce-a927-0069473283e2-kube-api-access-86l4n\") pod \"e2e-distinct-simulated-kserve-ff95456df-h59p5\" (UID: \"9cf36a00-ae1e-46ce-a927-0069473283e2\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.570634 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.570549 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:26.711310 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.711276 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-h59p5"] Jul 01 19:30:26.714174 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:30:26.714143 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf36a00_ae1e_46ce_a927_0069473283e2.slice/crio-3badd02b8b7e8607833dc66700bbb3acb5338d6b43d7012ab3c7eb94b18782eb WatchSource:0}: Error finding container 3badd02b8b7e8607833dc66700bbb3acb5338d6b43d7012ab3c7eb94b18782eb: Status 404 returned error can't find the container with id 3badd02b8b7e8607833dc66700bbb3acb5338d6b43d7012ab3c7eb94b18782eb Jul 01 19:30:26.989972 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:26.989873 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:30:27.686691 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:27.686642 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" event={"ID":"9cf36a00-ae1e-46ce-a927-0069473283e2","Type":"ContainerStarted","Data":"3badd02b8b7e8607833dc66700bbb3acb5338d6b43d7012ab3c7eb94b18782eb"} Jul 01 19:30:28.693304 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:28.693267 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" event={"ID":"9cf36a00-ae1e-46ce-a927-0069473283e2","Type":"ContainerStarted","Data":"841097ebed8936b64c557cb9d794ba4b60090627b368e78a8a5e806911c22f72"} Jul 01 19:30:28.712598 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:28.712547 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" podStartSLOduration=1.628057766 podStartE2EDuration="2.712531207s" totalImagesPullingTime="1.084473441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:28.711612416 +0000 UTC m=+725.806365493" watchObservedRunningTime="2026-07-01 19:30:28.712531207 +0000 UTC m=+725.807284295" Jul 01 19:30:36.571313 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:36.571275 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:36.571820 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:36.571332 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:36.583658 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:36.583631 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:36.741735 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:36.741706 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-h59p5" Jul 01 19:30:43.994370 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:43.994333 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:30:51.283290 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:30:51.283248 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:31:04.958894 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:04.958855 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm"] Jul 01 19:31:04.963181 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:04.963165 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:04.965980 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:04.965952 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 19:31:04.982490 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:04.982457 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm"] Jul 01 19:31:05.007667 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.007635 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.007811 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.007700 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.007811 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.007776 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.007897 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.007810 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0839efc-c188-4123-91fa-cf19a10e031c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.007897 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.007854 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6hl\" (UniqueName: \"kubernetes.io/projected/f0839efc-c188-4123-91fa-cf19a10e031c-kube-api-access-5t6hl\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.108617 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.108582 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.108817 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.108759 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.108864 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.108824 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.108906 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.108869 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0839efc-c188-4123-91fa-cf19a10e031c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.108941 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.108921 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6hl\" (UniqueName: \"kubernetes.io/projected/f0839efc-c188-4123-91fa-cf19a10e031c-kube-api-access-5t6hl\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.109165 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.109137 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.109165 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.109163 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.111012 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.110995 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0839efc-c188-4123-91fa-cf19a10e031c-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.111351 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.111332 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0839efc-c188-4123-91fa-cf19a10e031c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.118801 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.118779 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6hl\" (UniqueName: \"kubernetes.io/projected/f0839efc-c188-4123-91fa-cf19a10e031c-kube-api-access-5t6hl\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm\" (UID: \"f0839efc-c188-4123-91fa-cf19a10e031c\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.272678 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.272596 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:05.406152 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.406129 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm"] Jul 01 19:31:05.408413 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:31:05.408383 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0839efc_c188_4123_91fa_cf19a10e031c.slice/crio-2ed69648e1719627bca3ed8d682d7f10894a3e0df6fa7cbc4281d9f93cedaa2b WatchSource:0}: Error finding container 2ed69648e1719627bca3ed8d682d7f10894a3e0df6fa7cbc4281d9f93cedaa2b: Status 404 returned error can't find the container with id 2ed69648e1719627bca3ed8d682d7f10894a3e0df6fa7cbc4281d9f93cedaa2b Jul 01 19:31:05.865741 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.865653 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" event={"ID":"f0839efc-c188-4123-91fa-cf19a10e031c","Type":"ContainerStarted","Data":"074aa27487898bbcad4dcc5842ad0204aeb9c7f9f3c952ff089b2d2eac7fa189"} Jul 01 19:31:05.865741 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.865733 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" event={"ID":"f0839efc-c188-4123-91fa-cf19a10e031c","Type":"ContainerStarted","Data":"2ed69648e1719627bca3ed8d682d7f10894a3e0df6fa7cbc4281d9f93cedaa2b"} Jul 01 19:31:05.883340 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:05.883280 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" podStartSLOduration=1.695517325 podStartE2EDuration="1.883255447s" totalImagesPullingTime="187.738122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:05.882643507 +0000 UTC m=+762.977396590" watchObservedRunningTime="2026-07-01 19:31:05.883255447 +0000 UTC m=+762.978008509" Jul 01 19:31:06.078503 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:06.078467 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:31:09.348645 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.348617 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms"] Jul 01 19:31:09.352382 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.352361 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.356023 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.356000 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 19:31:09.364687 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.364668 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms"] Jul 01 19:31:09.445888 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.445845 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.445888 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.445892 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.446185 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.445961 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hmfk\" (UniqueName: \"kubernetes.io/projected/9b231942-5fe8-46b1-8be0-3dbe3f94a317-kube-api-access-7hmfk\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.446185 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.446001 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b231942-5fe8-46b1-8be0-3dbe3f94a317-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.446185 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.446044 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547310 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547272 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547359 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547384 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547417 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hmfk\" (UniqueName: \"kubernetes.io/projected/9b231942-5fe8-46b1-8be0-3dbe3f94a317-kube-api-access-7hmfk\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547498 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547440 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b231942-5fe8-46b1-8be0-3dbe3f94a317-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547774 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547753 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.547842 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.547758 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.549664 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.549643 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b231942-5fe8-46b1-8be0-3dbe3f94a317-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.549840 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.549823 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b231942-5fe8-46b1-8be0-3dbe3f94a317-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.556383 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.556361 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hmfk\" (UniqueName: \"kubernetes.io/projected/9b231942-5fe8-46b1-8be0-3dbe3f94a317-kube-api-access-7hmfk\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms\" (UID: \"9b231942-5fe8-46b1-8be0-3dbe3f94a317\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.662605 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.662578 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:09.797536 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.797505 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms"] Jul 01 19:31:09.800571 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:31:09.800544 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b231942_5fe8_46b1_8be0_3dbe3f94a317.slice/crio-a8ab3972892092e9ba29bc0e864cfed1f2f168c2422f83df6e41b05071315724 WatchSource:0}: Error finding container a8ab3972892092e9ba29bc0e864cfed1f2f168c2422f83df6e41b05071315724: Status 404 returned error can't find the container with id a8ab3972892092e9ba29bc0e864cfed1f2f168c2422f83df6e41b05071315724 Jul 01 19:31:09.886681 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:09.886652 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" event={"ID":"9b231942-5fe8-46b1-8be0-3dbe3f94a317","Type":"ContainerStarted","Data":"a8ab3972892092e9ba29bc0e864cfed1f2f168c2422f83df6e41b05071315724"} Jul 01 19:31:10.791518 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:10.791482 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-56lpr"] Jul 01 19:31:10.893506 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:10.893470 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" event={"ID":"9b231942-5fe8-46b1-8be0-3dbe3f94a317","Type":"ContainerStarted","Data":"52c9cc29d7f872941bb924907a735e9d2ea6eb91855b65eec17dd91e4079bd7f"} Jul 01 19:31:10.916324 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:10.916263 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" podStartSLOduration=1.7007077339999999 podStartE2EDuration="1.916240956s" totalImagesPullingTime="215.533222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:10.913563575 +0000 UTC m=+768.008316655" watchObservedRunningTime="2026-07-01 19:31:10.916240956 +0000 UTC m=+768.010994018" Jul 01 19:31:15.273700 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:15.273665 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:15.274233 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:15.273937 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:15.286456 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:15.286430 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:15.926992 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:15.926959 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm" Jul 01 19:31:19.662661 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:19.662627 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:19.663168 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:19.662674 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:19.675138 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:19.675112 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:31:19.946283 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:31:19.946204 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms" Jul 01 19:32:19.029489 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.029452 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7774959cd7-75856"] Jul 01 19:32:19.032948 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.032931 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.043078 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.043025 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7774959cd7-75856"] Jul 01 19:32:19.171596 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.171558 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d33f767f-9835-4841-960e-05a7162900b3-oidc-ca\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.171800 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.171663 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9xf\" (UniqueName: \"kubernetes.io/projected/d33f767f-9835-4841-960e-05a7162900b3-kube-api-access-xf9xf\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.171875 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.171793 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d33f767f-9835-4841-960e-05a7162900b3-tls-cert\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.272660 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.272617 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d33f767f-9835-4841-960e-05a7162900b3-tls-cert\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.272660 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.272663 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d33f767f-9835-4841-960e-05a7162900b3-oidc-ca\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.272878 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.272708 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9xf\" (UniqueName: \"kubernetes.io/projected/d33f767f-9835-4841-960e-05a7162900b3-kube-api-access-xf9xf\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.273468 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.273447 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d33f767f-9835-4841-960e-05a7162900b3-oidc-ca\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.275139 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.275115 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d33f767f-9835-4841-960e-05a7162900b3-tls-cert\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.280868 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.280805 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9xf\" (UniqueName: \"kubernetes.io/projected/d33f767f-9835-4841-960e-05a7162900b3-kube-api-access-xf9xf\") pod \"authorino-7774959cd7-75856\" (UID: \"d33f767f-9835-4841-960e-05a7162900b3\") " pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.342854 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.342825 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7774959cd7-75856" Jul 01 19:32:19.483822 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:19.483782 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7774959cd7-75856"] Jul 01 19:32:19.486254 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:32:19.486211 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd33f767f_9835_4841_960e_05a7162900b3.slice/crio-1f0bb55aa2ff8d33cc923081a39f9932e4b2319e0d1305c008922b95e1db4072 WatchSource:0}: Error finding container 1f0bb55aa2ff8d33cc923081a39f9932e4b2319e0d1305c008922b95e1db4072: Status 404 returned error can't find the container with id 1f0bb55aa2ff8d33cc923081a39f9932e4b2319e0d1305c008922b95e1db4072 Jul 01 19:32:20.212669 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.212583 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7774959cd7-75856" event={"ID":"d33f767f-9835-4841-960e-05a7162900b3","Type":"ContainerStarted","Data":"03e249fa46a7e486c3c927f527df596c3fe444bd698bd1d9dd445ab93e26e97d"} Jul 01 19:32:20.213646 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.213191 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7774959cd7-75856" event={"ID":"d33f767f-9835-4841-960e-05a7162900b3","Type":"ContainerStarted","Data":"1f0bb55aa2ff8d33cc923081a39f9932e4b2319e0d1305c008922b95e1db4072"} Jul 01 19:32:20.232805 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.232755 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7774959cd7-75856" podStartSLOduration=0.802144236 podStartE2EDuration="1.232739481s" totalImagesPullingTime="430.595245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:32:20.230314014 +0000 UTC m=+837.325067075" watchObservedRunningTime="2026-07-01 19:32:20.232739481 +0000 UTC m=+837.327492574" Jul 01 19:32:20.276255 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.276212 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57d68f7998-sm5r9"] Jul 01 19:32:20.276706 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.276447 2588 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57d68f7998-sm5r9" podUID="14e84d46-a420-4482-aeb1-5b26f33a050c" containerName="authorino" containerID="cri-o://74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da" gracePeriod=30 Jul 01 19:32:20.546626 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.546602 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:32:20.686957 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.686929 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tvmd\" (UniqueName: \"kubernetes.io/projected/14e84d46-a420-4482-aeb1-5b26f33a050c-kube-api-access-2tvmd\") pod \"14e84d46-a420-4482-aeb1-5b26f33a050c\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " Jul 01 19:32:20.687149 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.687008 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14e84d46-a420-4482-aeb1-5b26f33a050c-tls-cert\") pod \"14e84d46-a420-4482-aeb1-5b26f33a050c\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " Jul 01 19:32:20.687149 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.687031 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/14e84d46-a420-4482-aeb1-5b26f33a050c-oidc-ca\") pod \"14e84d46-a420-4482-aeb1-5b26f33a050c\" (UID: \"14e84d46-a420-4482-aeb1-5b26f33a050c\") " Jul 01 19:32:20.689493 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.689459 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e84d46-a420-4482-aeb1-5b26f33a050c-kube-api-access-2tvmd" (OuterVolumeSpecName: "kube-api-access-2tvmd") pod "14e84d46-a420-4482-aeb1-5b26f33a050c" (UID: "14e84d46-a420-4482-aeb1-5b26f33a050c"). InnerVolumeSpecName "kube-api-access-2tvmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:32:20.693272 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.693241 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14e84d46-a420-4482-aeb1-5b26f33a050c-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "14e84d46-a420-4482-aeb1-5b26f33a050c" (UID: "14e84d46-a420-4482-aeb1-5b26f33a050c"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:32:20.700856 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.700826 2588 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14e84d46-a420-4482-aeb1-5b26f33a050c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "14e84d46-a420-4482-aeb1-5b26f33a050c" (UID: "14e84d46-a420-4482-aeb1-5b26f33a050c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:32:20.788259 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.788164 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tvmd\" (UniqueName: \"kubernetes.io/projected/14e84d46-a420-4482-aeb1-5b26f33a050c-kube-api-access-2tvmd\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:32:20.788259 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.788189 2588 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14e84d46-a420-4482-aeb1-5b26f33a050c-tls-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:32:20.788259 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:20.788200 2588 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/14e84d46-a420-4482-aeb1-5b26f33a050c-oidc-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\"" Jul 01 19:32:21.219074 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.219024 2588 generic.go:356] "Generic (PLEG): container finished" podID="14e84d46-a420-4482-aeb1-5b26f33a050c" containerID="74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da" exitCode=0 Jul 01 19:32:21.219531 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.219088 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d68f7998-sm5r9" Jul 01 19:32:21.219531 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.219092 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d68f7998-sm5r9" event={"ID":"14e84d46-a420-4482-aeb1-5b26f33a050c","Type":"ContainerDied","Data":"74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da"} Jul 01 19:32:21.219531 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.219144 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d68f7998-sm5r9" event={"ID":"14e84d46-a420-4482-aeb1-5b26f33a050c","Type":"ContainerDied","Data":"3b2699aa522b400da6a0096c8abf30b107be8a6e973a0ab892a298049eafa3d8"} Jul 01 19:32:21.219531 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.219174 2588 scope.go:117] "RemoveContainer" containerID="74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da" Jul 01 19:32:21.228764 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.228746 2588 scope.go:117] "RemoveContainer" containerID="74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da" Jul 01 19:32:21.228990 ip-10-0-135-98 kubenswrapper[2588]: E0701 19:32:21.228973 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da\": container with ID starting with 74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da not found: ID does not exist" containerID="74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da" Jul 01 19:32:21.229049 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.228997 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da"} err="failed to get container status \"74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da\": rpc error: code = NotFound desc = could not find container \"74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da\": container with ID starting with 74cc03275c97a55bf87a9aeb1f7bafdbd7fb3f03329b795e804ee935b85ad7da not found: ID does not exist" Jul 01 19:32:21.246671 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.246642 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57d68f7998-sm5r9"] Jul 01 19:32:21.252783 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.252758 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57d68f7998-sm5r9"] Jul 01 19:32:21.335137 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:21.335099 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e84d46-a420-4482-aeb1-5b26f33a050c" path="/var/lib/kubelet/pods/14e84d46-a420-4482-aeb1-5b26f33a050c/volumes" Jul 01 19:32:59.025450 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:32:59.025415 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7774959cd7-75856_d33f767f-9835-4841-960e-05a7162900b3/authorino/0.log" Jul 01 19:33:04.373079 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:04.373034 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-nfn9p_c8e747bf-4603-4d3c-9cb9-11be12298f92/server/0.log" Jul 01 19:33:04.488093 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:04.488047 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-l9l8p_679bb779-7d18-45d8-adda-79e16c1bcea7/manager/0.log" Jul 01 19:33:04.621051 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:04.621022 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-987rl_0dd4dce1-d70c-4317-ae6a-581b90ab7ce3/copy-manifests/0.log" Jul 01 19:33:04.628955 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:04.628933 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-987rl_0dd4dce1-d70c-4317-ae6a-581b90ab7ce3/manager/0.log" Jul 01 19:33:06.242723 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:06.242697 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7774959cd7-75856_d33f767f-9835-4841-960e-05a7162900b3/authorino/0.log" Jul 01 19:33:06.599242 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:06.599166 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ck7f9_939a536e-e4d2-4e58-9e9e-82134b28224f/kuadrant-console-plugin/0.log" Jul 01 19:33:06.973374 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:06.973342 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-56lpr_c74f1bb5-0161-4b99-91f9-65feafe4cef1/limitador/0.log" Jul 01 19:33:07.680017 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:07.679991 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-bfzbx_2f319e5b-20f6-426e-a24e-f7dba94d4c25/kube-auth-proxy/0.log" Jul 01 19:33:08.720083 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:08.720032 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-h59p5_9cf36a00-ae1e-46ce-a927-0069473283e2/main/0.log" Jul 01 19:33:09.056672 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:09.056595 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-xj8lm_f0839efc-c188-4123-91fa-cf19a10e031c/main/0.log" Jul 01 19:33:09.165111 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:09.165081 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-6ktms_9b231942-5fe8-46b1-8be0-3dbe3f94a317/main/0.log" Jul 01 19:33:16.320283 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:16.320214 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nxldv_dd470645-2a19-4679-b59b-23e10114ce44/global-pull-secret-syncer/0.log" Jul 01 19:33:16.490966 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:16.490941 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m5grh_b022344e-a864-48fd-9799-272e7b7ef7f8/konnectivity-agent/0.log" Jul 01 19:33:16.549234 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:16.549207 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-98.ec2.internal_1294a42dcee61098075b8c041b6bfbf9/haproxy/0.log" Jul 01 19:33:21.638706 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:21.638676 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7774959cd7-75856_d33f767f-9835-4841-960e-05a7162900b3/authorino/0.log" Jul 01 19:33:21.731256 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:21.731227 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ck7f9_939a536e-e4d2-4e58-9e9e-82134b28224f/kuadrant-console-plugin/0.log" Jul 01 19:33:21.835280 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:21.835256 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-56lpr_c74f1bb5-0161-4b99-91f9-65feafe4cef1/limitador/0.log" Jul 01 19:33:23.326451 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.326424 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:33:23.332897 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.332874 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5qtk_7edd23c6-3fb5-4dd2-97d7-3ef959e293c8/ovn-acl-logging/0.log" Jul 01 19:33:23.608267 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.608196 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/alertmanager/0.log" Jul 01 19:33:23.638019 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.638001 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/config-reloader/0.log" Jul 01 19:33:23.665089 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.665054 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/kube-rbac-proxy-web/0.log" Jul 01 19:33:23.688189 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.688167 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/kube-rbac-proxy/0.log" Jul 01 19:33:23.715521 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.715498 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/kube-rbac-proxy-metric/0.log" Jul 01 19:33:23.738700 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.738676 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/prom-label-proxy/0.log" Jul 01 19:33:23.760910 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.760891 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b225d786-9030-49cf-9397-7e15c8da8eed/init-config-reloader/0.log" Jul 01 19:33:23.830530 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.830501 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-w7zhz_3ae90b05-e72a-45c6-a0e6-1530decd9ba7/kube-state-metrics/0.log" Jul 01 19:33:23.849996 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.849972 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-w7zhz_3ae90b05-e72a-45c6-a0e6-1530decd9ba7/kube-rbac-proxy-main/0.log" Jul 01 19:33:23.871861 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.871799 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-w7zhz_3ae90b05-e72a-45c6-a0e6-1530decd9ba7/kube-rbac-proxy-self/0.log" Jul 01 19:33:23.899013 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:23.898987 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-747675b68b-hbshv_5c9d3df3-fd38-4f05-8e0e-53fd78acc7e0/metrics-server/0.log" Jul 01 19:33:24.130975 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.130950 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbxvg_edc1a253-5c85-4436-98e2-6b5cbb203339/node-exporter/0.log" Jul 01 19:33:24.162732 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.162711 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbxvg_edc1a253-5c85-4436-98e2-6b5cbb203339/kube-rbac-proxy/0.log" Jul 01 19:33:24.217097 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.217071 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbxvg_edc1a253-5c85-4436-98e2-6b5cbb203339/init-textfile/0.log" Jul 01 19:33:24.587616 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.587588 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-cx428_e6851508-b4b2-4948-8566-1bf0e2e1385b/prometheus-operator/0.log" Jul 01 19:33:24.611037 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.611015 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-cx428_e6851508-b4b2-4948-8566-1bf0e2e1385b/kube-rbac-proxy/0.log" Jul 01 19:33:24.638434 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.638413 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-mgcxp_ed89f935-9405-4bc6-a57f-a5ba3aaab629/prometheus-operator-admission-webhook/0.log" Jul 01 19:33:24.669810 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.669793 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cb8d448f-x99sf_9ca846ce-0d3d-4366-8c27-39364db51fa6/telemeter-client/0.log" Jul 01 19:33:24.694241 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.694221 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cb8d448f-x99sf_9ca846ce-0d3d-4366-8c27-39364db51fa6/reload/0.log" Jul 01 19:33:24.718398 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:24.718350 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cb8d448f-x99sf_9ca846ce-0d3d-4366-8c27-39364db51fa6/kube-rbac-proxy/0.log" Jul 01 19:33:26.453555 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.453525 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4"] Jul 01 19:33:26.453907 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.453871 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e84d46-a420-4482-aeb1-5b26f33a050c" containerName="authorino" Jul 01 19:33:26.453907 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.453881 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e84d46-a420-4482-aeb1-5b26f33a050c" containerName="authorino" Jul 01 19:33:26.453973 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.453951 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e84d46-a420-4482-aeb1-5b26f33a050c" containerName="authorino" Jul 01 19:33:26.457295 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.457275 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.460423 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.460396 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ssrz\"/\"kube-root-ca.crt\"" Jul 01 19:33:26.461050 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.461026 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ssrz\"/\"default-dockercfg-q4zr5\"" Jul 01 19:33:26.461169 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.461118 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ssrz\"/\"openshift-service-ca.crt\"" Jul 01 19:33:26.468853 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.468820 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4"] Jul 01 19:33:26.575948 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.575909 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-podres\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.575948 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.575954 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-sys\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.576213 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.576025 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-proc\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.576213 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.576081 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgv8t\" (UniqueName: \"kubernetes.io/projected/2b7cc2f5-e739-441a-91ce-db26aea20aaf-kube-api-access-tgv8t\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.576213 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.576135 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-lib-modules\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677269 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677231 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-proc\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677277 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgv8t\" (UniqueName: \"kubernetes.io/projected/2b7cc2f5-e739-441a-91ce-db26aea20aaf-kube-api-access-tgv8t\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677316 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-lib-modules\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677346 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-podres\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677366 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-sys\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677445 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677373 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-proc\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677618 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677482 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-lib-modules\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677618 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677485 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-podres\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.677618 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.677520 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b7cc2f5-e739-441a-91ce-db26aea20aaf-sys\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.686450 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.686431 2588 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgv8t\" (UniqueName: \"kubernetes.io/projected/2b7cc2f5-e739-441a-91ce-db26aea20aaf-kube-api-access-tgv8t\") pod \"perf-node-gather-daemonset-zhdg4\" (UID: \"2b7cc2f5-e739-441a-91ce-db26aea20aaf\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.771456 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.771389 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:26.899021 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:26.898997 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4"] Jul 01 19:33:26.901181 ip-10-0-135-98 kubenswrapper[2588]: W0701 19:33:26.901157 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b7cc2f5_e739_441a_91ce_db26aea20aaf.slice/crio-2334ac1d474d6a2554428988045946028cf78f67723513f6c87d263f96ff1aca WatchSource:0}: Error finding container 2334ac1d474d6a2554428988045946028cf78f67723513f6c87d263f96ff1aca: Status 404 returned error can't find the container with id 2334ac1d474d6a2554428988045946028cf78f67723513f6c87d263f96ff1aca Jul 01 19:33:27.268466 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:27.268437 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d8d85dbc-q2b99_901ab6a1-3765-4c03-bf19-4a1c2580ffb6/console/0.log" Jul 01 19:33:27.298103 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:27.298005 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-hf9hv_073a15ee-4a69-4217-9f1d-3580fef42728/download-server/0.log" Jul 01 19:33:27.526930 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:27.526898 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" event={"ID":"2b7cc2f5-e739-441a-91ce-db26aea20aaf","Type":"ContainerStarted","Data":"0c682d28e6420733654747ea8f7e1374fbf8232da9494684942fde9d5c8cb1df"} Jul 01 19:33:27.527407 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:27.526949 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" event={"ID":"2b7cc2f5-e739-441a-91ce-db26aea20aaf","Type":"ContainerStarted","Data":"2334ac1d474d6a2554428988045946028cf78f67723513f6c87d263f96ff1aca"} Jul 01 19:33:27.527407 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:27.526970 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:27.544245 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:27.544198 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" podStartSLOduration=1.544183002 podStartE2EDuration="1.544183002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:33:27.542844359 +0000 UTC m=+904.637597421" watchObservedRunningTime="2026-07-01 19:33:27.544183002 +0000 UTC m=+904.638936063" Jul 01 19:33:29.087211 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:29.087181 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-srkql_16dc08f8-a652-4af2-9662-250441aeb70d/dns/0.log" Jul 01 19:33:29.109982 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:29.109956 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-srkql_16dc08f8-a652-4af2-9662-250441aeb70d/kube-rbac-proxy/0.log" Jul 01 19:33:29.162400 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:29.162377 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lp58q_24b5f333-5271-4beb-a719-e2c8307779d3/dns-node-resolver/0.log" Jul 01 19:33:29.738831 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:29.738799 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67654b9bc-jss5j_89f60ab2-0cb3-4fdd-b82d-22a3ae3d072c/registry/0.log" Jul 01 19:33:29.764890 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:29.764862 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b8mrb_6a8caa4a-edc6-4a8f-94a1-9f666d7319a6/node-ca/0.log" Jul 01 19:33:30.930122 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:30.930090 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-bfzbx_2f319e5b-20f6-426e-a24e-f7dba94d4c25/kube-auth-proxy/0.log" Jul 01 19:33:31.745925 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:31.745897 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jcw8n_cf31ca3d-1613-498b-914f-5d3c9fb3c61f/serve-healthcheck-canary/0.log" Jul 01 19:33:32.315550 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:32.315523 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8f5w8_1f63a7ba-95bf-4bc7-89e6-6318875c6fde/kube-rbac-proxy/0.log" Jul 01 19:33:32.340155 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:32.340121 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8f5w8_1f63a7ba-95bf-4bc7-89e6-6318875c6fde/exporter/0.log" Jul 01 19:33:32.364585 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:32.364557 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8f5w8_1f63a7ba-95bf-4bc7-89e6-6318875c6fde/extractor/0.log" Jul 01 19:33:33.541385 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:33.541361 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-zhdg4" Jul 01 19:33:34.917992 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:34.917967 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-nfn9p_c8e747bf-4603-4d3c-9cb9-11be12298f92/server/0.log" Jul 01 19:33:34.965638 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:34.965611 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-l9l8p_679bb779-7d18-45d8-adda-79e16c1bcea7/manager/0.log" Jul 01 19:33:34.999299 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:34.999264 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-987rl_0dd4dce1-d70c-4317-ae6a-581b90ab7ce3/manager/0.log" Jul 01 19:33:35.020997 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:35.020973 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-987rl_0dd4dce1-d70c-4317-ae6a-581b90ab7ce3/copy-manifests/0.log" Jul 01 19:33:36.801955 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:36.801871 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5464bb7789-drcww_c3fdf827-b4ee-4444-b296-343be242b2d5/manager/0.log" Jul 01 19:33:37.259833 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:37.259802 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-bfzbx_2f319e5b-20f6-426e-a24e-f7dba94d4c25/kube-auth-proxy/0.log" Jul 01 19:33:38.540868 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:38.540783 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-bfzbx_2f319e5b-20f6-426e-a24e-f7dba94d4c25/kube-auth-proxy/0.log" Jul 01 19:33:41.905641 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:41.905603 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-m7tf8_49d8390e-71f6-4017-ba68-e3e58b197e02/migrator/0.log" Jul 01 19:33:41.931705 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:41.931670 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-m7tf8_49d8390e-71f6-4017-ba68-e3e58b197e02/graceful-termination/0.log" Jul 01 19:33:43.549982 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.549951 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/kube-multus-additional-cni-plugins/0.log" Jul 01 19:33:43.575018 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.574998 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/egress-router-binary-copy/0.log" Jul 01 19:33:43.600421 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.600370 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/cni-plugins/0.log" Jul 01 19:33:43.624032 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.624011 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/bond-cni-plugin/0.log" Jul 01 19:33:43.646977 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.646948 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/routeoverride-cni/0.log" Jul 01 19:33:43.670181 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.670166 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/whereabouts-cni-bincopy/0.log" Jul 01 19:33:43.692488 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.692467 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l2rxc_4e795316-2daa-467f-8314-9dd493b73da1/whereabouts-cni/0.log" Jul 01 19:33:43.945304 ip-10-0-135-98 kubenswrapper[2588]: I0701 19:33:43.945272 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rhvv5_0e19668c-496c-4711-b887-41a2747eb123/kube-multus/0.log"